Max level shown:
1 [ Dec 21 02:45:52 Enabled. ]
2 [ Dec 21 02:45:52 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 21 02:45:52 Method "start" exited with status 0. ]
4 [ Dec 21 02:45:52 Rereading configuration. ]
5 [ Dec 21 02:45:52 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-21T02:45:52.295ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-21T02:45:52.295ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-21T02:45:52.347ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-21T02:45:52.347ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-21T02:45:52.463ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-21T02:45:52.472ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-21T02:45:52.480ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-21T02:45:53.084ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-12-21T02:45:53.222ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-21T02:45:53.222ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-21T02:45:53.222ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-21T02:45:53.222ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-21T02:45:53.222ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-12-21T02:45:53.222ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-21T02:45:53.225ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-21T02:45:53.225ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-21T02:45:53.225ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-21T02:45:53.225ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-21T02:45:53.225ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-21T02:45:53.225ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-21T02:45:53.225ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282024-12-21T02:45:53.225ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-21T02:45:53.225ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-21T02:45:53.237ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-21T02:45:53.237ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 18b40981-00da-48f4-b7f2-620c208131bb (zpool)
322024-12-21T02:45:53.335ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 18b40981-00da-48f4-b7f2-620c208131bb (zpool), kind: Internal }
332024-12-21T02:45:53.690ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342024-12-21T02:45:53.690ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-21T02:45:53.690ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-21T02:45:53.690ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-21T02:45:53.690ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382024-12-21T02:45:53.690ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-21T02:45:53.690ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-21T02:45:53.699ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-21T02:45:53.699ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = a5171080-2959-4ea4-a217-421d3a3b1186 (zpool)
422024-12-21T02:45:53.789ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a5171080-2959-4ea4-a217-421d3a3b1186 (zpool), kind: Internal }
432024-12-21T02:45:54.154ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-21T02:45:54.154ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18b40981-00da-48f4-b7f2-620c208131bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a5171080-2959-4ea4-a217-421d3a3b1186 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-21T02:45:54.154ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482024-12-21T02:45:54.154ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-21T02:45:54.154ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-21T02:45:54.154ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18b40981-00da-48f4-b7f2-620c208131bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a5171080-2959-4ea4-a217-421d3a3b1186 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-12-21T02:45:54.154ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542024-12-21T02:45:54.154ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-21T02:45:54.154ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-21T02:45:54.154ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18b40981-00da-48f4-b7f2-620c208131bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a5171080-2959-4ea4-a217-421d3a3b1186 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592024-12-21T02:45:54.154ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602024-12-21T02:45:54.154ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-12-21T02:45:54.154ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-21T02:45:54.154ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
632024-12-21T02:45:54.154ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642024-12-21T02:45:54.154ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18b40981-00da-48f4-b7f2-620c208131bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a5171080-2959-4ea4-a217-421d3a3b1186 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-12-21T02:45:54.154ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-21T02:45:54.154ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
692024-12-21T02:45:54.154ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
702024-12-21T02:45:54.154ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18b40981-00da-48f4-b7f2-620c208131bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a5171080-2959-4ea4-a217-421d3a3b1186 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712024-12-21T02:45:54.154ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
722024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
732024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
742024-12-21T02:45:54.154ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
752024-12-21T02:45:54.154ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
762024-12-21T02:45:54.154ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18b40981-00da-48f4-b7f2-620c208131bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a5171080-2959-4ea4-a217-421d3a3b1186 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
772024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
782024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
792024-12-21T02:45:54.154ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18b40981-00da-48f4-b7f2-620c208131bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a5171080-2959-4ea4-a217-421d3a3b1186 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
802024-12-21T02:45:54.154ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
812024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-12-21T02:45:54.154ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842024-12-21T02:45:54.154ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-12-21T02:45:54.154ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-21T02:45:54.154ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872024-12-21T02:45:54.154ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18b40981-00da-48f4-b7f2-620c208131bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a5171080-2959-4ea4-a217-421d3a3b1186 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
882024-12-21T02:45:54.154ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
892024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-12-21T02:45:54.154ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-12-21T02:45:54.154ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932024-12-21T02:45:54.154ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-12-21T02:45:54.154ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18b40981-00da-48f4-b7f2-620c208131bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a5171080-2959-4ea4-a217-421d3a3b1186 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-12-21T02:45:54.154ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-21T02:45:54.154ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-21T02:45:54.154ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1002024-12-21T02:45:54.154ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18b40981-00da-48f4-b7f2-620c208131bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a5171080-2959-4ea4-a217-421d3a3b1186 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-12-21T02:45:54.154ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032024-12-21T02:45:54.154ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-21T02:45:54.154ZINFOSledAgent (bootstore): No ledger in /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-12-21T02:45:54.154ZINFOSledAgent (bootstore): No ledger in /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-12-21T02:45:54.154ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-12-21T02:45:54.154ZINFOSledAgent (bootstore): No ledger in /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-12-21T02:45:54.154ZINFOSledAgent (bootstore): No ledger in /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-12-21T02:45:54.154ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-12-21T02:45:54.155ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-21T02:45:54.155ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-21T02:45:54.165ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132024-12-21T02:45:54.165ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1400, tv_nsec: 882574035 } time_to_next_cleanup = 599.999915339s
1142024-12-21T02:45:54.165ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
1152024-12-21T02:45:54.165ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162024-12-21T02:45:54.165ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-21T02:45:54.168ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-21T02:45:54.168ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-12-21T02:45:54.170ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-12-21T02:45:54.171ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-21T02:45:54.171ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-21T02:45:54.171ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232024-12-21T02:45:54.171ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242024-12-21T02:45:54.171ZINFOSledAgent (RSS): No ledger in /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-21T02:45:54.171ZINFOSledAgent (RSS): No ledger in /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-21T02:45:54.171ZINFOSledAgent (RSS): No ledger in /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-21T02:45:54.171ZINFOSledAgent (RSS): No ledger in /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-21T02:45:54.171ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-21T02:45:54.171ZINFOSledAgent (RSS): Writing ledger to /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-21T02:45:54.171ZINFOSledAgent (RSS): Writing ledger to /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-21T02:45:54.171ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-21T02:45:54.171ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-21T02:45:54.171ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-21T02:45:54.171ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-21T02:45:54.171ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362024-12-21T02:45:54.171ZINFOSledAgent (bootstore): Writing ledger to /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372024-12-21T02:45:54.171ZINFOSledAgent (bootstore): Writing ledger to /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382024-12-21T02:45:54.172ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392024-12-21T02:45:54.172ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 (sled), rack_id: e82f3ce5-f4b3-438e-a750-485ef194a2d5, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402024-12-21T02:45:54.172ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4259
1412024-12-21T02:45:54.172ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4659
1422024-12-21T02:45:54.177ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-21T02:45:54.182ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-21T02:45:54.182ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-21T02:45:54.187ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-21T02:45:54.187ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-21T02:45:54.187ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:53546
1482024-12-21T02:45:54.187ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 (sled), rack_id: e82f3ce5-f4b3-438e-a750-485ef194a2d5, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-21T02:45:54.187ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-21T02:45:54.187ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-21T02:45:54.187ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1522024-12-21T02:45:54.187ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1532024-12-21T02:45:54.187ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-12-21T02:45:54.187ZINFOSledAgent (StorageManager): No ledger in /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552024-12-21T02:45:54.187ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562024-12-21T02:45:54.187ZINFOSledAgent (StorageManager): No ledger in /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-21T02:45:54.188ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582024-12-21T02:45:54.188ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592024-12-21T02:45:54.188ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602024-12-21T02:45:54.188ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-21T02:45:54.188ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622024-12-21T02:45:54.205ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632024-12-21T02:45:54.226ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-21T02:45:54.243ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-21T02:45:54.269ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1662024-12-21T02:45:54.269ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672024-12-21T02:45:54.269ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1682024-12-21T02:45:54.269ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692024-12-21T02:45:54.272ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 91.028024ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6e41e419-0385-4cad-805a-5446ba8220c9", "content-length": "124", "date": "Sat, 21 Dec 2024 02:45:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6e41e419-0385-4cad-805a-5446ba8220c9" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-21T02:45:54.282ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_18b40981-00da-48f4-b7f2-620c208131bb/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-21T02:45:54.305ZINFOSledAgent: successfully created encrypted zvol: name="oxi_18b40981-00da-48f4-b7f2-620c208131bb/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-21T02:45:54.305ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_18b40981-00da-48f4-b7f2-620c208131bb/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-21T02:45:54.311ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1742024-12-21T02:45:54.311ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752024-12-21T02:45:54.311ZINFOSledAgent (BackingFs): Ensuring dataset oxi_18b40981-00da-48f4-b7f2-620c208131bb/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762024-12-21T02:45:54.364ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-12-21T02:45:54.364ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 178.863441ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9f553f77-52f7-4fc3-b643-3fd375910928", "content-length": "124", "date": "Sat, 21 Dec 2024 02:45:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9f553f77-52f7-4fc3-b643-3fd375910928" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-12-21T02:45:54.379ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792024-12-21T02:45:54.544ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-21T02:45:54.545ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 198.006494ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c6d7d4eb-1d8e-46d9-b0f6-fc44fccb395c", "content-length": "124", "date": "Sat, 21 Dec 2024 02:45:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c6d7d4eb-1d8e-46d9-b0f6-fc44fccb395c" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-21T02:45:54.598ZINFOSledAgent (BackingFs): Mounting oxi_18b40981-00da-48f4-b7f2-620c208131bb/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822024-12-21T02:45:54.611ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832024-12-21T02:45:54.611ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842024-12-21T02:45:54.611ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852024-12-21T02:45:54.611ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862024-12-21T02:45:54.744ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872024-12-21T02:45:54.745ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 87.702514ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b41486f7-9aed-4aab-b395-92a4bcec3d31", "content-length": "124", "date": "Sat, 21 Dec 2024 02:45:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b41486f7-9aed-4aab-b395-92a4bcec3d31" } file = clients/ddm-admin-client/src/lib.rs:177
1882024-12-21T02:45:54.833ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-21T02:45:54.834ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 113.829816ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3bc3b877-6454-4979-bb95-f14cf1813604", "content-length": "124", "date": "Sat, 21 Dec 2024 02:45:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3bc3b877-6454-4979-bb95-f14cf1813604" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-21T02:45:54.949ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-21T02:45:54.949ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 128.006418ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5508577d-afb1-45e1-b99c-efa212a8fe34", "content-length": "124", "date": "Sat, 21 Dec 2024 02:45:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5508577d-afb1-45e1-b99c-efa212a8fe34" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-21T02:45:55.079ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-12-21T02:45:55.079ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 421.369137ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2102886c-bc8b-4850-a167-f62d9f5d8e62", "content-length": "124", "date": "Sat, 21 Dec 2024 02:45:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2102886c-bc8b-4850-a167-f62d9f5d8e62" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-12-21T02:45:55.344ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1952024-12-21T02:45:55.350ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:43662 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1962024-12-21T02:45:55.350ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1972024-12-21T02:45:55.350ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:43662 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1982024-12-21T02:45:55.351ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 233.969617ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
1992024-12-21T02:45:55.352ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
2002024-12-21T02:45:55.352ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
2012024-12-21T02:45:55.352ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2022024-12-21T02:45:55.352ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032024-12-21T02:45:55.502ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042024-12-21T02:45:55.586ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 376.370861ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
2052024-12-21T02:45:55.964ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 576.60453ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
2062024-12-21T02:45:56.545ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.879423847s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
2072024-12-21T02:45:58.031ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2683
2082024-12-21T02:45:58.031ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2928
2092024-12-21T02:45:58.031ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2553
2102024-12-21T02:45:58.031ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2600
2112024-12-21T02:45:58.031ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3009
2122024-12-21T02:45:58.031ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3054
2132024-12-21T02:45:58.033ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2853
2142024-12-21T02:45:58.035ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2594
2152024-12-21T02:45:58.035ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='4a72b7dd-4681-40e1-99ca-ee46110d2a13'/> <propval type="astring" name="rack_id" value='e82f3ce5-f4b3-438e-a750-485ef194a2d5'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe14:4e4'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='e82f3ce5-f4b3-438e-a750-485ef194a2d5'/> <propval type="astring" name="sled_id" value='74b11855-33fc-4fcf-8c0e-d7e8e9d5e531'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='74b11855-33fc-4fcf-8c0e-d7e8e9d5e531'/> <propval type="astring" name="rack_uuid" value='e82f3ce5-f4b3-438e-a750-485ef194a2d5'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='74b11855-33fc-4fcf-8c0e-d7e8e9d5e531'/> <propval type="astring" name="rack_uuid" value='e82f3ce5-f4b3-438e-a750-485ef194a2d5'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162024-12-21T02:45:58.035ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172024-12-21T02:45:58.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 63.966868ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-21T02:45:58.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 67.812973ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-21T02:45:58.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 230.566625ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-21T02:45:59.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 498.79301ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-21T02:45:59.426ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.252229158s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
2222024-12-21T02:45:59.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 824.757711ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-21T02:46:00.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.276194549s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-21T02:46:01.680ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.275273899s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
2252024-12-21T02:46:01.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.292502112s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-12-21T02:46:03.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.280016606s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-12-21T02:46:05.118ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) file = sled-agent/src/nexus.rs:527 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
2282024-12-21T02:46:05.149ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2292024-12-21T02:46:05.149ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
2302024-12-21T02:46:05.151ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2312024-12-21T02:46:05.151ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2322024-12-21T02:46:05.151ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2332024-12-21T02:46:05.151ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342024-12-21T02:46:05.151ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352024-12-21T02:46:05.151ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2362024-12-21T02:46:05.151ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2372024-12-21T02:46:05.151ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
2382024-12-21T02:46:05.341ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:53546
2392024-12-21T02:46:05.341ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2402024-12-21T02:46:05.341ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2412024-12-21T02:46:05.348ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4283 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2422024-12-21T02:46:05.348ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4299
2432024-12-21T02:46:05.348ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2442024-12-21T02:46:05.556ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16040429980454400900 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
2452024-12-21T02:46:05.556ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
2462024-12-21T02:46:05.557ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8637994223622190982 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
2472024-12-21T02:46:05.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41935
2482024-12-21T02:46:05.584ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2492024-12-21T02:46:05.584ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2502024-12-21T02:46:05.584ZINFOSledAgent (ServiceManager): No ledger in /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/omicron-zones.json file = common/src/ledger.rs:188
2512024-12-21T02:46:05.584ZINFOSledAgent (ServiceManager): No ledger in /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/omicron-zones.json file = common/src/ledger.rs:188
2522024-12-21T02:46:05.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41935 req_id = 0f21849c-d19d-4117-a0b8-1c56e53e7e1c response_code = 200 uri = /inventory
2532024-12-21T02:46:05.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33363
2542024-12-21T02:46:05.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33363 req_id = fed9177a-eb77-4a60-8a6f-95d429f191c7 response_code = 200 uri = /sled-role
2552024-12-21T02:46:05.647ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 869f338c-55e7-4bd5-9132-566ec46664dd (physical_disk), pool_id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 3ceb482b-568a-4ec8-ac44-a6674179f9df (physical_disk), pool_id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 728b5d06-06cd-4e7d-ae90-0c0100b72a1e (physical_disk), pool_id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 129fca12-4171-4720-801f-8183cc5dc855 (physical_disk), pool_id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: b97fde2c-303d-4fdf-b664-b35198f79aa4 (physical_disk), pool_id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 6bc1e476-3b98-4544-b1c0-c5e1b678ec0d (physical_disk), pool_id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: cf992a8f-b7d7-4681-a2c8-79985c83fe8f (physical_disk), pool_id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 74e765b0-8ed7-4ff4-8796-524332f625a1 (physical_disk), pool_id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 23bde5c8-e953-4f4f-ac21-5edc06e3dccf (physical_disk), pool_id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2562024-12-21T02:46:05.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57099
2572024-12-21T02:46:05.647ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
2582024-12-21T02:46:05.647ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 869f338c-55e7-4bd5-9132-566ec46664dd (physical_disk), pool_id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 3ceb482b-568a-4ec8-ac44-a6674179f9df (physical_disk), pool_id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 728b5d06-06cd-4e7d-ae90-0c0100b72a1e (physical_disk), pool_id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 129fca12-4171-4720-801f-8183cc5dc855 (physical_disk), pool_id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: b97fde2c-303d-4fdf-b664-b35198f79aa4 (physical_disk), pool_id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 6bc1e476-3b98-4544-b1c0-c5e1b678ec0d (physical_disk), pool_id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: cf992a8f-b7d7-4681-a2c8-79985c83fe8f (physical_disk), pool_id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 74e765b0-8ed7-4ff4-8796-524332f625a1 (physical_disk), pool_id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 23bde5c8-e953-4f4f-ac21-5edc06e3dccf (physical_disk), pool_id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2592024-12-21T02:46:05.647ZINFOSledAgent (StorageManager): No ledger in /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2602024-12-21T02:46:05.647ZINFOSledAgent (StorageManager): No ledger in /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2612024-12-21T02:46:05.647ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2622024-12-21T02:46:05.647ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2632024-12-21T02:46:05.647ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2642024-12-21T02:46:05.647ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2652024-12-21T02:46:05.647ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2662024-12-21T02:46:05.657ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2672024-12-21T02:46:05.657ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool)
2682024-12-21T02:46:05.754ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }
2692024-12-21T02:46:05.761ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2702024-12-21T02:46:05.761ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2712024-12-21T02:46:05.761ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2722024-12-21T02:46:05.761ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2732024-12-21T02:46:05.761ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742024-12-21T02:46:05.761ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752024-12-21T02:46:05.761ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2762024-12-21T02:46:05.797ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2772024-12-21T02:46:05.805ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/zone file = sled-storage/src/dataset.rs:302
2782024-12-21T02:46:05.944ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_80c94f92-4b7a-4dba-9905-839fe80ef014 file = sled-storage/src/dataset.rs:388
2792024-12-21T02:46:05.952ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2802024-12-21T02:46:05.952ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2812024-12-21T02:46:05.952ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2822024-12-21T02:46:05.952ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2832024-12-21T02:46:05.952ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2842024-12-21T02:46:05.962ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2852024-12-21T02:46:05.962ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool)
2862024-12-21T02:46:06.057ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }
2872024-12-21T02:46:06.065ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2882024-12-21T02:46:06.065ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2892024-12-21T02:46:06.065ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2902024-12-21T02:46:06.065ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2912024-12-21T02:46:06.065ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922024-12-21T02:46:06.065ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932024-12-21T02:46:06.065ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2942024-12-21T02:46:06.099ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2952024-12-21T02:46:06.106ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/zone file = sled-storage/src/dataset.rs:302
2962024-12-21T02:46:06.153ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) file = sled-agent/src/probe_manager.rs:231 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
2972024-12-21T02:46:06.243ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9 file = sled-storage/src/dataset.rs:388
2982024-12-21T02:46:06.251ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2992024-12-21T02:46:06.251ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3002024-12-21T02:46:06.251ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3012024-12-21T02:46:06.251ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3022024-12-21T02:46:06.251ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3032024-12-21T02:46:06.261ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3042024-12-21T02:46:06.261ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool)
3052024-12-21T02:46:06.350ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }
3062024-12-21T02:46:06.358ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3072024-12-21T02:46:06.358ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3082024-12-21T02:46:06.358ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3092024-12-21T02:46:06.358ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3102024-12-21T02:46:06.358ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-12-21T02:46:06.358ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-12-21T02:46:06.358ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3132024-12-21T02:46:06.395ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3142024-12-21T02:46:06.404ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0/crypt/zone file = sled-storage/src/dataset.rs:302
3152024-12-21T02:46:06.539ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0 file = sled-storage/src/dataset.rs:388
3162024-12-21T02:46:06.547ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3172024-12-21T02:46:06.547ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3182024-12-21T02:46:06.547ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3192024-12-21T02:46:06.547ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3202024-12-21T02:46:06.547ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3212024-12-21T02:46:06.557ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3222024-12-21T02:46:06.557ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a1307d86-524f-4687-99b5-553fb50f6ebe (zpool)
3232024-12-21T02:46:06.651ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }
3242024-12-21T02:46:06.658ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3252024-12-21T02:46:06.658ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3262024-12-21T02:46:06.658ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3272024-12-21T02:46:06.659ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3282024-12-21T02:46:06.659ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292024-12-21T02:46:06.659ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-12-21T02:46:06.659ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3312024-12-21T02:46:06.695ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3322024-12-21T02:46:06.703ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a1307d86-524f-4687-99b5-553fb50f6ebe/crypt/zone file = sled-storage/src/dataset.rs:302
3332024-12-21T02:46:06.840ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a1307d86-524f-4687-99b5-553fb50f6ebe file = sled-storage/src/dataset.rs:388
3342024-12-21T02:46:06.848ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3352024-12-21T02:46:06.848ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3362024-12-21T02:46:06.848ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3372024-12-21T02:46:06.848ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3382024-12-21T02:46:06.848ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3392024-12-21T02:46:06.858ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3402024-12-21T02:46:06.858ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool)
3412024-12-21T02:46:06.954ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }
3422024-12-21T02:46:06.962ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3432024-12-21T02:46:06.962ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3442024-12-21T02:46:06.963ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3452024-12-21T02:46:06.963ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3462024-12-21T02:46:06.963ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-12-21T02:46:06.963ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-12-21T02:46:06.963ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3492024-12-21T02:46:06.998ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3502024-12-21T02:46:07.006ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12/crypt/zone file = sled-storage/src/dataset.rs:302
3512024-12-21T02:46:07.143ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12 file = sled-storage/src/dataset.rs:388
3522024-12-21T02:46:07.151ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3532024-12-21T02:46:07.151ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3542024-12-21T02:46:07.151ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3552024-12-21T02:46:07.151ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3562024-12-21T02:46:07.151ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3572024-12-21T02:46:07.160ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3582024-12-21T02:46:07.160ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 98af376c-57d5-4d4e-8868-ff737627f482 (zpool)
3592024-12-21T02:46:07.256ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }
3602024-12-21T02:46:07.264ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3612024-12-21T02:46:07.264ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3622024-12-21T02:46:07.264ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3632024-12-21T02:46:07.264ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3642024-12-21T02:46:07.264ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-12-21T02:46:07.264ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-12-21T02:46:07.264ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3672024-12-21T02:46:07.268ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) file = sled-agent/src/probe_manager.rs:231 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
3682024-12-21T02:46:07.299ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3692024-12-21T02:46:07.308ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_98af376c-57d5-4d4e-8868-ff737627f482/crypt/zone file = sled-storage/src/dataset.rs:302
3702024-12-21T02:46:07.446ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_98af376c-57d5-4d4e-8868-ff737627f482 file = sled-storage/src/dataset.rs:388
3712024-12-21T02:46:07.454ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3722024-12-21T02:46:07.454ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3732024-12-21T02:46:07.454ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3742024-12-21T02:46:07.454ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3752024-12-21T02:46:07.454ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3762024-12-21T02:46:07.464ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3772024-12-21T02:46:07.464ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool)
3782024-12-21T02:46:07.557ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }
3792024-12-21T02:46:07.565ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3802024-12-21T02:46:07.565ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3812024-12-21T02:46:07.565ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3822024-12-21T02:46:07.565ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3832024-12-21T02:46:07.565ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-12-21T02:46:07.565ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-12-21T02:46:07.565ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3862024-12-21T02:46:07.600ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3872024-12-21T02:46:07.608ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_63c9df44-0622-415c-a697-efc3e7bc6c27/crypt/zone file = sled-storage/src/dataset.rs:302
3882024-12-21T02:46:07.743ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_63c9df44-0622-415c-a697-efc3e7bc6c27 file = sled-storage/src/dataset.rs:388
3892024-12-21T02:46:07.751ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3902024-12-21T02:46:07.751ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3912024-12-21T02:46:07.751ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3922024-12-21T02:46:07.751ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3932024-12-21T02:46:07.751ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3942024-12-21T02:46:07.760ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3952024-12-21T02:46:07.760ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool)
3962024-12-21T02:46:07.856ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }
3972024-12-21T02:46:07.864ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3982024-12-21T02:46:07.864ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3992024-12-21T02:46:07.864ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4002024-12-21T02:46:07.864ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4012024-12-21T02:46:07.864ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022024-12-21T02:46:07.864ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032024-12-21T02:46:07.864ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4042024-12-21T02:46:07.898ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4052024-12-21T02:46:07.906ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_81a0e2aa-7a9f-464b-aaff-78e01f8fe036/crypt/zone file = sled-storage/src/dataset.rs:302
4062024-12-21T02:46:08.051ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_81a0e2aa-7a9f-464b-aaff-78e01f8fe036 file = sled-storage/src/dataset.rs:388
4072024-12-21T02:46:08.060ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4082024-12-21T02:46:08.060ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4092024-12-21T02:46:08.060ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4102024-12-21T02:46:08.060ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4112024-12-21T02:46:08.060ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4122024-12-21T02:46:08.070ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4132024-12-21T02:46:08.070ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool)
4142024-12-21T02:46:08.165ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }
4152024-12-21T02:46:08.173ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4162024-12-21T02:46:08.173ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4172024-12-21T02:46:08.173ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4182024-12-21T02:46:08.173ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4192024-12-21T02:46:08.173ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202024-12-21T02:46:08.173ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212024-12-21T02:46:08.173ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4222024-12-21T02:46:08.210ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4232024-12-21T02:46:08.218ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc/crypt/zone file = sled-storage/src/dataset.rs:302
4242024-12-21T02:46:08.270ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) file = sled-agent/src/probe_manager.rs:231 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4252024-12-21T02:46:08.366ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc file = sled-storage/src/dataset.rs:388
4262024-12-21T02:46:08.374ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4272024-12-21T02:46:08.374ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4282024-12-21T02:46:08.374ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4292024-12-21T02:46:08.374ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 18b40981-00da-48f4-b7f2-620c208131bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a5171080-2959-4ea4-a217-421d3a3b1186 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4302024-12-21T02:46:08.374ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4312024-12-21T02:46:08.374ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4322024-12-21T02:46:08.374ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4332024-12-21T02:46:08.374ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4342024-12-21T02:46:08.374ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4352024-12-21T02:46:08.374ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4362024-12-21T02:46:08.374ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4372024-12-21T02:46:08.374ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4382024-12-21T02:46:08.374ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4392024-12-21T02:46:08.374ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4402024-12-21T02:46:08.374ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4412024-12-21T02:46:08.374ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4422024-12-21T02:46:08.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2727697 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57099 req_id = 3976b470-3183-4e51-83b5-ceabbd646482 response_code = 200 uri = /omicron-physical-disks
4432024-12-21T02:46:08.406ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {02143115-b58e-481e-940f-cab35384deb4 (dataset): DatasetConfig { id: 02143115-b58e-481e-940f-cab35384deb4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 113d9488-a817-4a8e-9828-78176a4cd19f (dataset): DatasetConfig { id: 113d9488-a817-4a8e-9828-78176a4cd19f (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 117bd378-53e0-446c-93ea-811ed99e7d4e (dataset): DatasetConfig { id: 117bd378-53e0-446c-93ea-811ed99e7d4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 120aef78-06b5-43f1-9f45-8e2d42d3a879 (dataset): DatasetConfig { id: 120aef78-06b5-43f1-9f45-8e2d42d3a879 (dataset), name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 137e0d9e-9639-45bb-b6d9-115369de705e (dataset): DatasetConfig { id: 137e0d9e-9639-45bb-b6d9-115369de705e (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14d20481-40f4-4431-ac14-586cfc21036d (dataset): DatasetConfig { id: 14d20481-40f4-4431-ac14-586cfc21036d (dataset), name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a38364e-3993-4934-9fe8-674de8f7b29c (dataset): DatasetConfig { id: 1a38364e-3993-4934-9fe8-674de8f7b29c (dataset), name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f993338-cbe3-47e5-a948-a517cc287548 (dataset): DatasetConfig { id: 1f993338-cbe3-47e5-a948-a517cc287548 (dataset), name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 210f6576-6b7a-401f-a1ef-58a16c73f5f5 (dataset): DatasetConfig { id: 210f6576-6b7a-401f-a1ef-58a16c73f5f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 275c132f-77ff-41d8-9fd1-341e098cf048 (dataset): DatasetConfig { id: 275c132f-77ff-41d8-9fd1-341e098cf048 (dataset), name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2af5e9f1-d21f-4fc1-9411-95e51ebf43b5 (dataset): DatasetConfig { id: 2af5e9f1-d21f-4fc1-9411-95e51ebf43b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 301187bd-fe1f-4847-81a3-13b528c4bed0 (dataset): DatasetConfig { id: 301187bd-fe1f-4847-81a3-13b528c4bed0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34448145-96e9-4444-b99d-310d4b8582a1 (dataset): DatasetConfig { id: 34448145-96e9-4444-b99d-310d4b8582a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38f65c7f-05e5-498a-b579-5015e80448e6 (dataset): DatasetConfig { id: 38f65c7f-05e5-498a-b579-5015e80448e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d090901-5deb-465c-a631-420bbb86276a (dataset): DatasetConfig { id: 3d090901-5deb-465c-a631-420bbb86276a (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4126a666-e410-41a7-97af-76e847ff9218 (dataset): DatasetConfig { id: 4126a666-e410-41a7-97af-76e847ff9218 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42e7f9ac-5255-4c81-8699-c079db373c64 (dataset): DatasetConfig { id: 42e7f9ac-5255-4c81-8699-c079db373c64 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 441831cf-3e71-41e8-aa74-57043c5b92dd (dataset): DatasetConfig { id: 441831cf-3e71-41e8-aa74-57043c5b92dd (dataset), name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 467249cc-f84e-473d-9baf-759d5bea5f36 (dataset): DatasetConfig { id: 467249cc-f84e-473d-9baf-759d5bea5f36 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 504aa91b-9bd5-4fce-a94a-f22b8fe3fd7b (dataset): DatasetConfig { id: 504aa91b-9bd5-4fce-a94a-f22b8fe3fd7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5436446b-4419-4eb7-9f76-6a1a39ce1350 (dataset): DatasetConfig { id: 5436446b-4419-4eb7-9f76-6a1a39ce1350 (dataset), name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54736e94-52de-404e-821c-0329504d8418 (dataset): DatasetConfig { id: 54736e94-52de-404e-821c-0329504d8418 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54de31e3-e406-4488-97e6-f3e4bfac24b1 (dataset): DatasetConfig { id: 54de31e3-e406-4488-97e6-f3e4bfac24b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5aa4f4fe-7a54-40c5-8f4b-ecad65528c07 (dataset): DatasetConfig { id: 5aa4f4fe-7a54-40c5-8f4b-ecad65528c07 (dataset), name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5ae03f3d-3511-4ab2-b225-1746f358f352 (dataset): DatasetConfig { id: 5ae03f3d-3511-4ab2-b225-1746f358f352 (dataset), name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 617d1112-cff8-40ac-805c-d72863440810 (dataset): DatasetConfig { id: 617d1112-cff8-40ac-805c-d72863440810 (dataset), name: DatasetName { pool_name: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 61b31528-da21-4289-ab47-db5645d9125a (dataset): DatasetConfig { id: 61b31528-da21-4289-ab47-db5645d9125a (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6326d5c7-1d22-489a-b94d-fd24fe903594 (dataset): DatasetConfig { id: 6326d5c7-1d22-489a-b94d-fd24fe903594 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_75db992d-930a-40c5-8e96-16838343192b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 635866df-85ca-4111-8835-a1e11523c28a (dataset): DatasetConfig { id: 635866df-85ca-4111-8835-a1e11523c28a (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b507d12-2dda-418a-9beb-a74b2915e928 (dataset): DatasetConfig { id: 6b507d12-2dda-418a-9beb-a74b2915e928 (dataset), name: DatasetName { pool_name: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7aafc07b-e573-4a61-b742-21b06a708ddf (dataset): DatasetConfig { id: 7aafc07b-e573-4a61-b742-21b06a708ddf (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c348807-4c8c-47ef-84eb-33bb395f27b8 (dataset): DatasetConfig { id: 7c348807-4c8c-47ef-84eb-33bb395f27b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7dc526bb-00f1-42e0-a95c-f8ea65dce89e (dataset): DatasetConfig { id: 7dc526bb-00f1-42e0-a95c-f8ea65dce89e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 811cb1bf-58b4-4dd1-8956-f35df08bd737 (dataset): DatasetConfig { id: 811cb1bf-58b4-4dd1-8956-f35df08bd737 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8547370f-df16-4ecf-a62c-16114d347283 (dataset): DatasetConfig { id: 8547370f-df16-4ecf-a62c-16114d347283 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 88071920-ae7b-400d-ab82-3de822fadcf6 (dataset): DatasetConfig { id: 88071920-ae7b-400d-ab82-3de822fadcf6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f0cafc6-e9c5-4c06-9dca-d9d07b9d7517 (dataset): DatasetConfig { id: 8f0cafc6-e9c5-4c06-9dca-d9d07b9d7517 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 931b3f31-c14e-46ae-8c30-4c9a657b3c06 (dataset): DatasetConfig { id: 931b3f31-c14e-46ae-8c30-4c9a657b3c06 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ac0d9b0-f7fc-4268-8774-a4843669baed (dataset): DatasetConfig { id: 9ac0d9b0-f7fc-4268-8774-a4843669baed (dataset), name: DatasetName { pool_name: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ca8f7e9-65c7-47ff-887e-a88627ce2a7f (dataset): DatasetConfig { id: 9ca8f7e9-65c7-47ff-887e-a88627ce2a7f (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a393f0ed-9ece-4dcb-83f6-3be359808dcc (dataset): DatasetConfig { id: a393f0ed-9ece-4dcb-83f6-3be359808dcc (dataset), name: DatasetName { pool_name: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a6a09d83-cb2c-4c38-844b-8cae4a467566 (dataset): DatasetConfig { id: a6a09d83-cb2c-4c38-844b-8cae4a467566 (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af74ceaf-1ede-4cac-a7a3-d43e736b3829 (dataset): DatasetConfig { id: af74ceaf-1ede-4cac-a7a3-d43e736b3829 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, afdbc7d0-a5cf-40d2-8122-0d0ade659364 (dataset): DatasetConfig { id: afdbc7d0-a5cf-40d2-8122-0d0ade659364 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3721d3d-4aed-4842-873d-e857e4efe2d0 (dataset): DatasetConfig { id: b3721d3d-4aed-4842-873d-e857e4efe2d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b69a1732-42e8-49a5-b1fc-b37129f131b8 (dataset): DatasetConfig { id: b69a1732-42e8-49a5-b1fc-b37129f131b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7385309-69f5-437c-a9d1-cc9cf7efd869 (dataset): DatasetConfig { id: b7385309-69f5-437c-a9d1-cc9cf7efd869 (dataset), name: DatasetName { pool_name: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc5ef582-713a-4dfa-a610-43fb92ededc2 (dataset): DatasetConfig { id: bc5ef582-713a-4dfa-a610-43fb92ededc2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c28cc09b-2d8c-47f0-b273-58fa2342aada (dataset): DatasetConfig { id: c28cc09b-2d8c-47f0-b273-58fa2342aada (dataset), name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3781c24-b980-460b-ba85-5bc874b8f72d (dataset): DatasetConfig { id: c3781c24-b980-460b-ba85-5bc874b8f72d (dataset), name: DatasetName { pool_name: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c5d3146e-2248-41bf-be36-a8301e30c77a (dataset): DatasetConfig { id: c5d3146e-2248-41bf-be36-a8301e30c77a (dataset), name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c69732e4-d6f4-475c-8b1c-adec19ea81b3 (dataset): DatasetConfig { id: c69732e4-d6f4-475c-8b1c-adec19ea81b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc2c081d-0254-4cb1-b061-5d2c5b04625b (dataset): DatasetConfig { id: cc2c081d-0254-4cb1-b061-5d2c5b04625b (dataset), name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d101f000-5b8f-4fa3-8af8-ba7efbb00d29 (dataset): DatasetConfig { id: d101f000-5b8f-4fa3-8af8-ba7efbb00d29 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7eca1a7-7f3a-4fa8-a1f4-4aa1f18c8dab (dataset): DatasetConfig { id: d7eca1a7-7f3a-4fa8-a1f4-4aa1f18c8dab (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d864912e-4508-42f2-8279-e1d8806748fd (dataset): DatasetConfig { id: d864912e-4508-42f2-8279-e1d8806748fd (dataset), name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d8b8cd55-6750-4775-a549-f27c25dbb718 (dataset): DatasetConfig { id: d8b8cd55-6750-4775-a549-f27c25dbb718 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, deaec801-fe1c-49a7-877e-915ee9d74a35 (dataset): DatasetConfig { id: deaec801-fe1c-49a7-877e-915ee9d74a35 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e29468fc-54ed-498b-bc63-015892827c3f (dataset): DatasetConfig { id: e29468fc-54ed-498b-bc63-015892827c3f (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e5928009-7549-4e52-8c3c-d302385f2b1d (dataset): DatasetConfig { id: e5928009-7549-4e52-8c3c-d302385f2b1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6690ba7-1f84-48c1-b9b5-22281ce9087b (dataset): DatasetConfig { id: e6690ba7-1f84-48c1-b9b5-22281ce9087b (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e9775c5a-cd16-4b0d-8dba-63e6e2e9d793 (dataset): DatasetConfig { id: e9775c5a-cd16-4b0d-8dba-63e6e2e9d793 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee4dcb05-486e-4445-b246-ffa4d9dfda5d (dataset): DatasetConfig { id: ee4dcb05-486e-4445-b246-ffa4d9dfda5d (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f26fe95d-12e8-49cf-9464-8dc97c45f2ab (dataset): DatasetConfig { id: f26fe95d-12e8-49cf-9464-8dc97c45f2ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4c5d1ed-922d-43cd-a50c-cf19d2de9c23 (dataset): DatasetConfig { id: f4c5d1ed-922d-43cd-a50c-cf19d2de9c23 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa4fb6db-42d1-4ca6-870d-c562dce9599f (dataset): DatasetConfig { id: fa4fb6db-42d1-4ca6-870d-c562dce9599f (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4442024-12-21T02:46:08.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43563
4452024-12-21T02:46:08.406ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4462024-12-21T02:46:08.407ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {02143115-b58e-481e-940f-cab35384deb4 (dataset): DatasetConfig { id: 02143115-b58e-481e-940f-cab35384deb4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 113d9488-a817-4a8e-9828-78176a4cd19f (dataset): DatasetConfig { id: 113d9488-a817-4a8e-9828-78176a4cd19f (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 117bd378-53e0-446c-93ea-811ed99e7d4e (dataset): DatasetConfig { id: 117bd378-53e0-446c-93ea-811ed99e7d4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 120aef78-06b5-43f1-9f45-8e2d42d3a879 (dataset): DatasetConfig { id: 120aef78-06b5-43f1-9f45-8e2d42d3a879 (dataset), name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 137e0d9e-9639-45bb-b6d9-115369de705e (dataset): DatasetConfig { id: 137e0d9e-9639-45bb-b6d9-115369de705e (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14d20481-40f4-4431-ac14-586cfc21036d (dataset): DatasetConfig { id: 14d20481-40f4-4431-ac14-586cfc21036d (dataset), name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a38364e-3993-4934-9fe8-674de8f7b29c (dataset): DatasetConfig { id: 1a38364e-3993-4934-9fe8-674de8f7b29c (dataset), name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f993338-cbe3-47e5-a948-a517cc287548 (dataset): DatasetConfig { id: 1f993338-cbe3-47e5-a948-a517cc287548 (dataset), name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 210f6576-6b7a-401f-a1ef-58a16c73f5f5 (dataset): DatasetConfig { id: 210f6576-6b7a-401f-a1ef-58a16c73f5f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 275c132f-77ff-41d8-9fd1-341e098cf048 (dataset): DatasetConfig { id: 275c132f-77ff-41d8-9fd1-341e098cf048 (dataset), name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2af5e9f1-d21f-4fc1-9411-95e51ebf43b5 (dataset): DatasetConfig { id: 2af5e9f1-d21f-4fc1-9411-95e51ebf43b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 301187bd-fe1f-4847-81a3-13b528c4bed0 (dataset): DatasetConfig { id: 301187bd-fe1f-4847-81a3-13b528c4bed0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34448145-96e9-4444-b99d-310d4b8582a1 (dataset): DatasetConfig { id: 34448145-96e9-4444-b99d-310d4b8582a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38f65c7f-05e5-498a-b579-5015e80448e6 (dataset): DatasetConfig { id: 38f65c7f-05e5-498a-b579-5015e80448e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d090901-5deb-465c-a631-420bbb86276a (dataset): DatasetConfig { id: 3d090901-5deb-465c-a631-420bbb86276a (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4126a666-e410-41a7-97af-76e847ff9218 (dataset): DatasetConfig { id: 4126a666-e410-41a7-97af-76e847ff9218 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42e7f9ac-5255-4c81-8699-c079db373c64 (dataset): DatasetConfig { id: 42e7f9ac-5255-4c81-8699-c079db373c64 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 441831cf-3e71-41e8-aa74-57043c5b92dd (dataset): DatasetConfig { id: 441831cf-3e71-41e8-aa74-57043c5b92dd (dataset), name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 467249cc-f84e-473d-9baf-759d5bea5f36 (dataset): DatasetConfig { id: 467249cc-f84e-473d-9baf-759d5bea5f36 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 504aa91b-9bd5-4fce-a94a-f22b8fe3fd7b (dataset): DatasetConfig { id: 504aa91b-9bd5-4fce-a94a-f22b8fe3fd7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5436446b-4419-4eb7-9f76-6a1a39ce1350 (dataset): DatasetConfig { id: 5436446b-4419-4eb7-9f76-6a1a39ce1350 (dataset), name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54736e94-52de-404e-821c-0329504d8418 (dataset): DatasetConfig { id: 54736e94-52de-404e-821c-0329504d8418 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54de31e3-e406-4488-97e6-f3e4bfac24b1 (dataset): DatasetConfig { id: 54de31e3-e406-4488-97e6-f3e4bfac24b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5aa4f4fe-7a54-40c5-8f4b-ecad65528c07 (dataset): DatasetConfig { id: 5aa4f4fe-7a54-40c5-8f4b-ecad65528c07 (dataset), name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5ae03f3d-3511-4ab2-b225-1746f358f352 (dataset): DatasetConfig { id: 5ae03f3d-3511-4ab2-b225-1746f358f352 (dataset), name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 617d1112-cff8-40ac-805c-d72863440810 (dataset): DatasetConfig { id: 617d1112-cff8-40ac-805c-d72863440810 (dataset), name: DatasetName { pool_name: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 61b31528-da21-4289-ab47-db5645d9125a (dataset): DatasetConfig { id: 61b31528-da21-4289-ab47-db5645d9125a (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6326d5c7-1d22-489a-b94d-fd24fe903594 (dataset): DatasetConfig { id: 6326d5c7-1d22-489a-b94d-fd24fe903594 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_75db992d-930a-40c5-8e96-16838343192b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 635866df-85ca-4111-8835-a1e11523c28a (dataset): DatasetConfig { id: 635866df-85ca-4111-8835-a1e11523c28a (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b507d12-2dda-418a-9beb-a74b2915e928 (dataset): DatasetConfig { id: 6b507d12-2dda-418a-9beb-a74b2915e928 (dataset), name: DatasetName { pool_name: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7aafc07b-e573-4a61-b742-21b06a708ddf (dataset): DatasetConfig { id: 7aafc07b-e573-4a61-b742-21b06a708ddf (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c348807-4c8c-47ef-84eb-33bb395f27b8 (dataset): DatasetConfig { id: 7c348807-4c8c-47ef-84eb-33bb395f27b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7dc526bb-00f1-42e0-a95c-f8ea65dce89e (dataset): DatasetConfig { id: 7dc526bb-00f1-42e0-a95c-f8ea65dce89e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 811cb1bf-58b4-4dd1-8956-f35df08bd737 (dataset): DatasetConfig { id: 811cb1bf-58b4-4dd1-8956-f35df08bd737 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8547370f-df16-4ecf-a62c-16114d347283 (dataset): DatasetConfig { id: 8547370f-df16-4ecf-a62c-16114d347283 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 88071920-ae7b-400d-ab82-3de822fadcf6 (dataset): DatasetConfig { id: 88071920-ae7b-400d-ab82-3de822fadcf6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f0cafc6-e9c5-4c06-9dca-d9d07b9d7517 (dataset): DatasetConfig { id: 8f0cafc6-e9c5-4c06-9dca-d9d07b9d7517 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 931b3f31-c14e-46ae-8c30-4c9a657b3c06 (dataset): DatasetConfig { id: 931b3f31-c14e-46ae-8c30-4c9a657b3c06 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ac0d9b0-f7fc-4268-8774-a4843669baed (dataset): DatasetConfig { id: 9ac0d9b0-f7fc-4268-8774-a4843669baed (dataset), name: DatasetName { pool_name: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ca8f7e9-65c7-47ff-887e-a88627ce2a7f (dataset): DatasetConfig { id: 9ca8f7e9-65c7-47ff-887e-a88627ce2a7f (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a393f0ed-9ece-4dcb-83f6-3be359808dcc (dataset): DatasetConfig { id: a393f0ed-9ece-4dcb-83f6-3be359808dcc (dataset), name: DatasetName { pool_name: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a6a09d83-cb2c-4c38-844b-8cae4a467566 (dataset): DatasetConfig { id: a6a09d83-cb2c-4c38-844b-8cae4a467566 (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af74ceaf-1ede-4cac-a7a3-d43e736b3829 (dataset): DatasetConfig { id: af74ceaf-1ede-4cac-a7a3-d43e736b3829 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, afdbc7d0-a5cf-40d2-8122-0d0ade659364 (dataset): DatasetConfig { id: afdbc7d0-a5cf-40d2-8122-0d0ade659364 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3721d3d-4aed-4842-873d-e857e4efe2d0 (dataset): DatasetConfig { id: b3721d3d-4aed-4842-873d-e857e4efe2d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b69a1732-42e8-49a5-b1fc-b37129f131b8 (dataset): DatasetConfig { id: b69a1732-42e8-49a5-b1fc-b37129f131b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7385309-69f5-437c-a9d1-cc9cf7efd869 (dataset): DatasetConfig { id: b7385309-69f5-437c-a9d1-cc9cf7efd869 (dataset), name: DatasetName { pool_name: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc5ef582-713a-4dfa-a610-43fb92ededc2 (dataset): DatasetConfig { id: bc5ef582-713a-4dfa-a610-43fb92ededc2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c28cc09b-2d8c-47f0-b273-58fa2342aada (dataset): DatasetConfig { id: c28cc09b-2d8c-47f0-b273-58fa2342aada (dataset), name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3781c24-b980-460b-ba85-5bc874b8f72d (dataset): DatasetConfig { id: c3781c24-b980-460b-ba85-5bc874b8f72d (dataset), name: DatasetName { pool_name: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c5d3146e-2248-41bf-be36-a8301e30c77a (dataset): DatasetConfig { id: c5d3146e-2248-41bf-be36-a8301e30c77a (dataset), name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c69732e4-d6f4-475c-8b1c-adec19ea81b3 (dataset): DatasetConfig { id: c69732e4-d6f4-475c-8b1c-adec19ea81b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc2c081d-0254-4cb1-b061-5d2c5b04625b (dataset): DatasetConfig { id: cc2c081d-0254-4cb1-b061-5d2c5b04625b (dataset), name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d101f000-5b8f-4fa3-8af8-ba7efbb00d29 (dataset): DatasetConfig { id: d101f000-5b8f-4fa3-8af8-ba7efbb00d29 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7eca1a7-7f3a-4fa8-a1f4-4aa1f18c8dab (dataset): DatasetConfig { id: d7eca1a7-7f3a-4fa8-a1f4-4aa1f18c8dab (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d864912e-4508-42f2-8279-e1d8806748fd (dataset): DatasetConfig { id: d864912e-4508-42f2-8279-e1d8806748fd (dataset), name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d8b8cd55-6750-4775-a549-f27c25dbb718 (dataset): DatasetConfig { id: d8b8cd55-6750-4775-a549-f27c25dbb718 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, deaec801-fe1c-49a7-877e-915ee9d74a35 (dataset): DatasetConfig { id: deaec801-fe1c-49a7-877e-915ee9d74a35 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e29468fc-54ed-498b-bc63-015892827c3f (dataset): DatasetConfig { id: e29468fc-54ed-498b-bc63-015892827c3f (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e5928009-7549-4e52-8c3c-d302385f2b1d (dataset): DatasetConfig { id: e5928009-7549-4e52-8c3c-d302385f2b1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6690ba7-1f84-48c1-b9b5-22281ce9087b (dataset): DatasetConfig { id: e6690ba7-1f84-48c1-b9b5-22281ce9087b (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e9775c5a-cd16-4b0d-8dba-63e6e2e9d793 (dataset): DatasetConfig { id: e9775c5a-cd16-4b0d-8dba-63e6e2e9d793 (dataset), name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee4dcb05-486e-4445-b246-ffa4d9dfda5d (dataset): DatasetConfig { id: ee4dcb05-486e-4445-b246-ffa4d9dfda5d (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f26fe95d-12e8-49cf-9464-8dc97c45f2ab (dataset): DatasetConfig { id: f26fe95d-12e8-49cf-9464-8dc97c45f2ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4c5d1ed-922d-43cd-a50c-cf19d2de9c23 (dataset): DatasetConfig { id: f4c5d1ed-922d-43cd-a50c-cf19d2de9c23 (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa4fb6db-42d1-4ca6-870d-c562dce9599f (dataset): DatasetConfig { id: fa4fb6db-42d1-4ca6-870d-c562dce9599f (dataset), name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4472024-12-21T02:46:08.407ZINFOSledAgent (StorageManager): No ledger in /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482024-12-21T02:46:08.407ZINFOSledAgent (StorageManager): No ledger in /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4492024-12-21T02:46:08.407ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4502024-12-21T02:46:08.423ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4512024-12-21T02:46:08.423ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4522024-12-21T02:46:08.423ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/debug"), full_name: "oxp_80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/debug" } file = sled-storage/src/manager.rs:1431
4532024-12-21T02:46:08.453ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4542024-12-21T02:46:08.453ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4552024-12-21T02:46:08.453ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/63c9df44-0622-415c-a697-efc3e7bc6c27/crypt/zone/oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c"), full_name: "oxp_63c9df44-0622-415c-a697-efc3e7bc6c27/crypt/zone/oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c" } file = sled-storage/src/manager.rs:1431
4562024-12-21T02:46:08.512ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4572024-12-21T02:46:08.512ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4582024-12-21T02:46:08.512ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/zone/oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf"), full_name: "oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/zone/oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf" } file = sled-storage/src/manager.rs:1431
4592024-12-21T02:46:08.569ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4602024-12-21T02:46:08.569ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4612024-12-21T02:46:08.569ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a1307d86-524f-4687-99b5-553fb50f6ebe/crypt/zone/oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d"), full_name: "oxp_a1307d86-524f-4687-99b5-553fb50f6ebe/crypt/zone/oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d" } file = sled-storage/src/manager.rs:1431
4622024-12-21T02:46:08.629ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4632024-12-21T02:46:08.629ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4642024-12-21T02:46:08.629ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cae4be-2aa4-46cb-b515-4b676301fb12/crypt/zone"), full_name: "oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12/crypt/zone" } file = sled-storage/src/manager.rs:1431
4652024-12-21T02:46:08.658ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4662024-12-21T02:46:08.658ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4672024-12-21T02:46:08.658ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/74fb7ca7-c189-47c2-a76d-c538432fe1f0/crypt/zone/oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e"), full_name: "oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0/crypt/zone/oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e" } file = sled-storage/src/manager.rs:1431
4682024-12-21T02:46:08.714ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4692024-12-21T02:46:08.714ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4702024-12-21T02:46:08.714ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a1307d86-524f-4687-99b5-553fb50f6ebe/crypt/zone/oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14"), full_name: "oxp_a1307d86-524f-4687-99b5-553fb50f6ebe/crypt/zone/oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14" } file = sled-storage/src/manager.rs:1431
4712024-12-21T02:46:08.772ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4722024-12-21T02:46:08.772ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4732024-12-21T02:46:08.772ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a1307d86-524f-4687-99b5-553fb50f6ebe/crypt/zone/oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0"), full_name: "oxp_a1307d86-524f-4687-99b5-553fb50f6ebe/crypt/zone/oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0" } file = sled-storage/src/manager.rs:1431
4742024-12-21T02:46:08.832ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4752024-12-21T02:46:08.832ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4762024-12-21T02:46:08.832ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4772024-12-21T02:46:08.881ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4782024-12-21T02:46:08.881ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4792024-12-21T02:46:08.881ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4802024-12-21T02:46:08.929ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4812024-12-21T02:46:08.929ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4822024-12-21T02:46:08.929ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cae4be-2aa4-46cb-b515-4b676301fb12/crypt/zone/oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3"), full_name: "oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12/crypt/zone/oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3" } file = sled-storage/src/manager.rs:1431
4832024-12-21T02:46:08.988ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4842024-12-21T02:46:08.988ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4852024-12-21T02:46:08.988ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/zone/oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5"), full_name: "oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/zone/oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5" } file = sled-storage/src/manager.rs:1431
4862024-12-21T02:46:09.045ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4872024-12-21T02:46:09.045ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4882024-12-21T02:46:09.045ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
4892024-12-21T02:46:09.095ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4902024-12-21T02:46:09.095ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4912024-12-21T02:46:09.095ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/74fb7ca7-c189-47c2-a76d-c538432fe1f0/crypt/zone/oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d"), full_name: "oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0/crypt/zone/oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d" } file = sled-storage/src/manager.rs:1431
4922024-12-21T02:46:09.155ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4932024-12-21T02:46:09.155ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4942024-12-21T02:46:09.155ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/zone/oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3"), full_name: "oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/zone/oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3" } file = sled-storage/src/manager.rs:1431
4952024-12-21T02:46:09.214ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962024-12-21T02:46:09.214ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4972024-12-21T02:46:09.214ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/zone/oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f"), full_name: "oxp_80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/zone/oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f" } file = sled-storage/src/manager.rs:1431
4982024-12-21T02:46:09.272ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) file = sled-agent/src/probe_manager.rs:231 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
4992024-12-21T02:46:09.273ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5002024-12-21T02:46:09.273ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5012024-12-21T02:46:09.273ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/zone/oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727"), full_name: "oxp_80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/zone/oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727" } file = sled-storage/src/manager.rs:1431
5022024-12-21T02:46:09.332ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5032024-12-21T02:46:09.332ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5042024-12-21T02:46:09.332ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a1307d86-524f-4687-99b5-553fb50f6ebe/crypt/zone"), full_name: "oxp_a1307d86-524f-4687-99b5-553fb50f6ebe/crypt/zone" } file = sled-storage/src/manager.rs:1431
5052024-12-21T02:46:09.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5062024-12-21T02:46:09.362ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5072024-12-21T02:46:09.362ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/zone/oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416"), full_name: "oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/zone/oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416" } file = sled-storage/src/manager.rs:1431
5082024-12-21T02:46:09.418ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5092024-12-21T02:46:09.418ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5102024-12-21T02:46:09.418ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3dccbcf8-70cb-4bd3-b798-64a7f92511cc/crypt/zone/oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b"), full_name: "oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc/crypt/zone/oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b" } file = sled-storage/src/manager.rs:1431
5112024-12-21T02:46:09.477ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5122024-12-21T02:46:09.477ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5132024-12-21T02:46:09.477ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a1307d86-524f-4687-99b5-553fb50f6ebe/crucible" } file = sled-storage/src/manager.rs:1431
5142024-12-21T02:46:09.526ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5152024-12-21T02:46:09.526ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5162024-12-21T02:46:09.526ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/zone/oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33"), full_name: "oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/zone/oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33" } file = sled-storage/src/manager.rs:1431
5172024-12-21T02:46:09.584ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5182024-12-21T02:46:09.584ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5192024-12-21T02:46:09.584ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12/crucible" } file = sled-storage/src/manager.rs:1431
5202024-12-21T02:46:09.632ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5212024-12-21T02:46:09.632ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5222024-12-21T02:46:09.632ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0/crucible" } file = sled-storage/src/manager.rs:1431
5232024-12-21T02:46:09.678ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5242024-12-21T02:46:09.678ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5252024-12-21T02:46:09.678ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a1307d86-524f-4687-99b5-553fb50f6ebe/crypt/zone/oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9"), full_name: "oxp_a1307d86-524f-4687-99b5-553fb50f6ebe/crypt/zone/oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9" } file = sled-storage/src/manager.rs:1431
5262024-12-21T02:46:09.738ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5272024-12-21T02:46:09.738ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5282024-12-21T02:46:09.738ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/98af376c-57d5-4d4e-8868-ff737627f482/crypt/debug"), full_name: "oxp_98af376c-57d5-4d4e-8868-ff737627f482/crypt/debug" } file = sled-storage/src/manager.rs:1431
5292024-12-21T02:46:09.767ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5302024-12-21T02:46:09.768ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5312024-12-21T02:46:09.768ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5322024-12-21T02:46:09.816ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5332024-12-21T02:46:09.816ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5342024-12-21T02:46:09.816ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3dccbcf8-70cb-4bd3-b798-64a7f92511cc/crypt/zone/oxz_crucible_75db992d-930a-40c5-8e96-16838343192b"), full_name: "oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc/crypt/zone/oxz_crucible_75db992d-930a-40c5-8e96-16838343192b" } file = sled-storage/src/manager.rs:1431
5352024-12-21T02:46:09.875ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5362024-12-21T02:46:09.875ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5372024-12-21T02:46:09.875ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/zone/oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289"), full_name: "oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/zone/oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289" } file = sled-storage/src/manager.rs:1431
5382024-12-21T02:46:09.932ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5392024-12-21T02:46:09.932ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5402024-12-21T02:46:09.932ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/98af376c-57d5-4d4e-8868-ff737627f482/crypt/zone"), full_name: "oxp_98af376c-57d5-4d4e-8868-ff737627f482/crypt/zone" } file = sled-storage/src/manager.rs:1431
5412024-12-21T02:46:09.961ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5422024-12-21T02:46:09.961ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5432024-12-21T02:46:09.961ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/zone/oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738"), full_name: "oxp_80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/zone/oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738" } file = sled-storage/src/manager.rs:1431
5442024-12-21T02:46:10.022ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5452024-12-21T02:46:10.022ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5462024-12-21T02:46:10.022ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cae4be-2aa4-46cb-b515-4b676301fb12/crypt/debug"), full_name: "oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12/crypt/debug" } file = sled-storage/src/manager.rs:1431
5472024-12-21T02:46:10.053ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5482024-12-21T02:46:10.053ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5492024-12-21T02:46:10.053ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc/crucible" } file = sled-storage/src/manager.rs:1431
5502024-12-21T02:46:10.102ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5512024-12-21T02:46:10.103ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5522024-12-21T02:46:10.103ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/zone/oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c"), full_name: "oxp_80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/zone/oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c" } file = sled-storage/src/manager.rs:1431
5532024-12-21T02:46:10.163ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5542024-12-21T02:46:10.163ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5552024-12-21T02:46:10.163ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/81a0e2aa-7a9f-464b-aaff-78e01f8fe036/crypt/zone"), full_name: "oxp_81a0e2aa-7a9f-464b-aaff-78e01f8fe036/crypt/zone" } file = sled-storage/src/manager.rs:1431
5562024-12-21T02:46:10.192ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5572024-12-21T02:46:10.192ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5582024-12-21T02:46:10.192ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cae4be-2aa4-46cb-b515-4b676301fb12/crypt/zone/oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8"), full_name: "oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12/crypt/zone/oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8" } file = sled-storage/src/manager.rs:1431
5592024-12-21T02:46:10.251ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5602024-12-21T02:46:10.251ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5612024-12-21T02:46:10.251ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9/crucible" } file = sled-storage/src/manager.rs:1431
5622024-12-21T02:46:10.274ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) file = sled-agent/src/probe_manager.rs:231 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
5632024-12-21T02:46:10.298ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5642024-12-21T02:46:10.299ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5652024-12-21T02:46:10.299ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_81a0e2aa-7a9f-464b-aaff-78e01f8fe036/crucible" } file = sled-storage/src/manager.rs:1431
5662024-12-21T02:46:10.347ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5672024-12-21T02:46:10.347ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5682024-12-21T02:46:10.347ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3dccbcf8-70cb-4bd3-b798-64a7f92511cc/crypt/zone"), full_name: "oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc/crypt/zone" } file = sled-storage/src/manager.rs:1431
5692024-12-21T02:46:10.376ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5702024-12-21T02:46:10.376ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5712024-12-21T02:46:10.376ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5722024-12-21T02:46:10.425ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5732024-12-21T02:46:10.425ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5742024-12-21T02:46:10.425ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3dccbcf8-70cb-4bd3-b798-64a7f92511cc/crypt/debug"), full_name: "oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc/crypt/debug" } file = sled-storage/src/manager.rs:1431
5752024-12-21T02:46:10.454ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5762024-12-21T02:46:10.454ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5772024-12-21T02:46:10.454ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/63c9df44-0622-415c-a697-efc3e7bc6c27/crypt/zone"), full_name: "oxp_63c9df44-0622-415c-a697-efc3e7bc6c27/crypt/zone" } file = sled-storage/src/manager.rs:1431
5782024-12-21T02:46:10.484ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792024-12-21T02:46:10.484ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5802024-12-21T02:46:10.484ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/debug"), full_name: "oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/debug" } file = sled-storage/src/manager.rs:1431
5812024-12-21T02:46:10.512ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5822024-12-21T02:46:10.512ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5832024-12-21T02:46:10.512ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3dccbcf8-70cb-4bd3-b798-64a7f92511cc/crypt/zone/oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f"), full_name: "oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc/crypt/zone/oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f" } file = sled-storage/src/manager.rs:1431
5842024-12-21T02:46:10.570ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5852024-12-21T02:46:10.570ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5862024-12-21T02:46:10.570ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_98af376c-57d5-4d4e-8868-ff737627f482/crucible" } file = sled-storage/src/manager.rs:1431
5872024-12-21T02:46:10.618ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5882024-12-21T02:46:10.618ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5892024-12-21T02:46:10.618ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/74fb7ca7-c189-47c2-a76d-c538432fe1f0/crypt/zone"), full_name: "oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0/crypt/zone" } file = sled-storage/src/manager.rs:1431
5902024-12-21T02:46:10.647ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5912024-12-21T02:46:10.647ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5922024-12-21T02:46:10.647ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/98af376c-57d5-4d4e-8868-ff737627f482/crypt/zone/oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec"), full_name: "oxp_98af376c-57d5-4d4e-8868-ff737627f482/crypt/zone/oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec" } file = sled-storage/src/manager.rs:1431
5932024-12-21T02:46:10.708ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5942024-12-21T02:46:10.708ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5952024-12-21T02:46:10.708ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/74fb7ca7-c189-47c2-a76d-c538432fe1f0/crypt/zone/oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f"), full_name: "oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0/crypt/zone/oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f" } file = sled-storage/src/manager.rs:1431
5962024-12-21T02:46:10.767ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5972024-12-21T02:46:10.767ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5982024-12-21T02:46:10.767ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5992024-12-21T02:46:10.817ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6002024-12-21T02:46:10.817ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6012024-12-21T02:46:10.817ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/81a0e2aa-7a9f-464b-aaff-78e01f8fe036/crypt/debug"), full_name: "oxp_81a0e2aa-7a9f-464b-aaff-78e01f8fe036/crypt/debug" } file = sled-storage/src/manager.rs:1431
6022024-12-21T02:46:10.846ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6032024-12-21T02:46:10.846ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6042024-12-21T02:46:10.846ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a1307d86-524f-4687-99b5-553fb50f6ebe/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6052024-12-21T02:46:10.898ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6062024-12-21T02:46:10.898ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6072024-12-21T02:46:10.898ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/zone/oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33"), full_name: "oxp_80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/zone/oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33" } file = sled-storage/src/manager.rs:1431
6082024-12-21T02:46:10.957ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6092024-12-21T02:46:10.957ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6102024-12-21T02:46:10.957ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/74fb7ca7-c189-47c2-a76d-c538432fe1f0/crypt/debug"), full_name: "oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0/crypt/debug" } file = sled-storage/src/manager.rs:1431
6112024-12-21T02:46:10.960ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 14.042359419s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
6122024-12-21T02:46:10.986ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6132024-12-21T02:46:10.986ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6142024-12-21T02:46:10.986ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cae4be-2aa4-46cb-b515-4b676301fb12/crypt/zone/oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110"), full_name: "oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12/crypt/zone/oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110" } file = sled-storage/src/manager.rs:1431
6152024-12-21T02:46:11.047ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6162024-12-21T02:46:11.048ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6172024-12-21T02:46:11.048ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/63c9df44-0622-415c-a697-efc3e7bc6c27/crypt/debug"), full_name: "oxp_63c9df44-0622-415c-a697-efc3e7bc6c27/crypt/debug" } file = sled-storage/src/manager.rs:1431
6182024-12-21T02:46:11.078ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6192024-12-21T02:46:11.078ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6202024-12-21T02:46:11.078ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a1307d86-524f-4687-99b5-553fb50f6ebe/crypt/debug"), full_name: "oxp_a1307d86-524f-4687-99b5-553fb50f6ebe/crypt/debug" } file = sled-storage/src/manager.rs:1431
6212024-12-21T02:46:11.108ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6222024-12-21T02:46:11.108ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6232024-12-21T02:46:11.108ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6242024-12-21T02:46:11.157ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6252024-12-21T02:46:11.157ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6262024-12-21T02:46:11.157ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/81a0e2aa-7a9f-464b-aaff-78e01f8fe036/crypt/zone/oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd"), full_name: "oxp_81a0e2aa-7a9f-464b-aaff-78e01f8fe036/crypt/zone/oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd" } file = sled-storage/src/manager.rs:1431
6272024-12-21T02:46:11.217ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6282024-12-21T02:46:11.217ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6292024-12-21T02:46:11.218ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/zone"), full_name: "oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/zone" } file = sled-storage/src/manager.rs:1431
6302024-12-21T02:46:11.247ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6312024-12-21T02:46:11.248ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6322024-12-21T02:46:11.248ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6332024-12-21T02:46:11.279ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) file = sled-agent/src/probe_manager.rs:231 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
6342024-12-21T02:46:11.297ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352024-12-21T02:46:11.297ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6362024-12-21T02:46:11.297ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_80c94f92-4b7a-4dba-9905-839fe80ef014/crucible" } file = sled-storage/src/manager.rs:1431
6372024-12-21T02:46:11.345ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382024-12-21T02:46:11.345ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6392024-12-21T02:46:11.345ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6402024-12-21T02:46:11.394ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412024-12-21T02:46:11.394ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422024-12-21T02:46:11.394ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/zone/oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d"), full_name: "oxp_80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/zone/oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d" } file = sled-storage/src/manager.rs:1431
6432024-12-21T02:46:11.455ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442024-12-21T02:46:11.455ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6452024-12-21T02:46:11.455ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_63c9df44-0622-415c-a697-efc3e7bc6c27/crucible" } file = sled-storage/src/manager.rs:1431
6462024-12-21T02:46:11.503ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6472024-12-21T02:46:11.503ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6482024-12-21T02:46:11.503ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6492024-12-21T02:46:11.552ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6502024-12-21T02:46:11.552ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6512024-12-21T02:46:11.552ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/zone"), full_name: "oxp_80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/zone" } file = sled-storage/src/manager.rs:1431
6522024-12-21T02:46:11.581ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6532024-12-21T02:46:11.581ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6542024-12-21T02:46:11.582ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
6552024-12-21T02:46:11.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3175792 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43563 req_id = d8548b6a-a608-4fa2-a610-dc359f707ac8 response_code = 200 uri = /datasets
6562024-12-21T02:46:11.614ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 4bf02835-271c-4b1b-a7ae-b005eed1920c (service), filesystem_pool: Some(ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: fb98f734-c99a-4ecb-bba3-508a9b86a289 (service), filesystem_pool: Some(ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: da604828-d4f1-4898-b180-39aa8632768d (service), filesystem_pool: Some(ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6572024-12-21T02:46:11.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57879
6582024-12-21T02:46:11.615ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6592024-12-21T02:46:11.615ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6602024-12-21T02:46:11.624ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6612024-12-21T02:46:11.624ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622024-12-21T02:46:11.633ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6632024-12-21T02:46:11.633ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6642024-12-21T02:46:11.641ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6652024-12-21T02:46:11.641ZINFOSledAgent (ServiceManager): No ledger in /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/omicron-zones.json file = common/src/ledger.rs:188
6662024-12-21T02:46:11.641ZINFOSledAgent (ServiceManager): No ledger in /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/omicron-zones.json file = common/src/ledger.rs:188
6672024-12-21T02:46:11.641ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682024-12-21T02:46:11.685ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692024-12-21T02:46:11.685ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702024-12-21T02:46:11.685ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712024-12-21T02:46:11.737ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d file = illumos-utils/src/zone.rs:325
6722024-12-21T02:46:11.740ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c file = illumos-utils/src/zone.rs:325
6732024-12-21T02:46:11.744ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289 file = illumos-utils/src/zone.rs:325
6742024-12-21T02:46:11.756ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d file = illumos-utils/src/zone.rs:363
6752024-12-21T02:46:11.761ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c file = illumos-utils/src/zone.rs:363
6762024-12-21T02:46:11.765ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289 file = illumos-utils/src/zone.rs:363
6772024-12-21T02:46:12.281ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) file = sled-agent/src/probe_manager.rs:231 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
6782024-12-21T02:46:13.347ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6792024-12-21T02:46:13.347ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6802024-12-21T02:46:13.828ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812024-12-21T02:46:13.828ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289
6822024-12-21T02:46:13.832ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6832024-12-21T02:46:14.313ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6842024-12-21T02:46:14.313ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c
6852024-12-21T02:46:14.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289") failed: Property not found. retry in 41.322041ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289
6862024-12-21T02:46:14.330ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6872024-12-21T02:46:14.330ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d
6882024-12-21T02:46:14.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289") failed: Property not found. retry in 105.483867ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289
6892024-12-21T02:46:14.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c") failed: Property not found. retry in 64.229634ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c
6902024-12-21T02:46:14.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d") failed: Property not found. retry in 25.858793ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d
6912024-12-21T02:46:14.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d") failed: Property not found. retry in 91.616326ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d
6922024-12-21T02:46:14.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289") failed: Property not found. retry in 258.87575ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289
6932024-12-21T02:46:14.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c") failed: Property not found. retry in 103.071555ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c
6942024-12-21T02:46:14.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d") failed: Property not found. retry in 186.20523ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d
6952024-12-21T02:46:14.804ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4307
6962024-12-21T02:46:14.806ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4317 gateway = fd00:1122:3344:101::1
6972024-12-21T02:46:14.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c") failed: Property not found. retry in 239.693294ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c
6982024-12-21T02:46:14.832ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4331 gateway = fd00:1122:3344:101::1
6992024-12-21T02:46:14.832ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4396
7002024-12-21T02:46:14.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289") failed: Property not found. retry in 343.368465ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289
7012024-12-21T02:46:14.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d") failed: Property not found. retry in 544.263314ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d
7022024-12-21T02:46:15.044ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4462
7032024-12-21T02:46:15.044ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4489
7042024-12-21T02:46:15.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c") failed: Property not found. retry in 552.392945ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c
7052024-12-21T02:46:15.099ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4502
7062024-12-21T02:46:15.100ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4348
7072024-12-21T02:46:15.122ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10298858320280328207 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
7082024-12-21T02:46:15.122ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8787551135208442133 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
7092024-12-21T02:46:15.170ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4390
7102024-12-21T02:46:15.170ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4469 rack_subnet = fd00:1122:3344::
7112024-12-21T02:46:15.193ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4480
7122024-12-21T02:46:15.194ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4522
7132024-12-21T02:46:15.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289") failed: Property not found. retry in 709.665963ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289
7142024-12-21T02:46:15.274ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4554
7152024-12-21T02:46:15.274ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4560
7162024-12-21T02:46:15.370ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4601
7172024-12-21T02:46:15.370ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7182024-12-21T02:46:15.404ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7192024-12-21T02:46:15.437ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7202024-12-21T02:46:15.437ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7212024-12-21T02:46:15.438ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7222024-12-21T02:46:15.438ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7232024-12-21T02:46:15.475ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
7242024-12-21T02:46:15.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d") failed: Property not found. retry in 1.036193297s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d
7252024-12-21T02:46:15.525ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7262024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7272024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7282024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7292024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7302024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7312024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7322024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7332024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7342024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7352024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7362024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7372024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7382024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7392024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7402024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7412024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7422024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7432024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7442024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7452024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7462024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7472024-12-21T02:46:15.525ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7482024-12-21T02:46:15.559ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16040429980454400900 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
7492024-12-21T02:46:15.559ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8637994223622190982 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
7502024-12-21T02:46:15.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c") failed: Property not found. retry in 549.991398ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c
7512024-12-21T02:46:15.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289") failed: Property not found. retry in 995.814629ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289
7522024-12-21T02:46:16.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c") failed: Property not found. retry in 724.805235ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c
7532024-12-21T02:46:16.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d") failed: Property not found. retry in 826.626288ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d
7542024-12-21T02:46:16.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289") failed: Property not found. retry in 938.561478ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289
7552024-12-21T02:46:16.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c") failed: Property not found. retry in 665.474256ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c
7562024-12-21T02:46:17.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d") failed: Property not found. retry in 731.178013ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d
7572024-12-21T02:46:17.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c") failed: Property not found. retry in 650.458704ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c
7582024-12-21T02:46:17.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289") failed: Property not found. retry in 895.540689ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289
7592024-12-21T02:46:18.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d") failed: Property not found. retry in 1.113057846s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d
7602024-12-21T02:46:18.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c") failed: Property not found. retry in 1.267440333s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c
7612024-12-21T02:46:18.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289") failed: Property not found. retry in 1.062432361s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289
7622024-12-21T02:46:19.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d") failed: Property not found. retry in 1.041288726s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d
7632024-12-21T02:46:19.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c") failed: Property not found. retry in 720.431999ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c
7642024-12-21T02:46:20.294ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_da604828-d4f1-4898-b180-39aa8632768d
7652024-12-21T02:46:20.295ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_4bf02835-271c-4b1b-a7ae-b005eed1920c
7662024-12-21T02:46:20.295ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_fb98f734-c99a-4ecb-bba3-508a9b86a289
7672024-12-21T02:46:20.295ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7682024-12-21T02:46:20.295ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7692024-12-21T02:46:20.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8680813 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57879 req_id = 43ab3a6e-6d6d-43c3-851d-d892b489a753 response_code = 204 uri = /omicron-zones
7702024-12-21T02:46:20.297ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7712024-12-21T02:46:20.493ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 55.557726ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7722024-12-21T02:46:20.550ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 153.584903ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7732024-12-21T02:46:20.723ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7742024-12-21T02:46:20.772ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7752024-12-21T02:46:20.817ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7762024-12-21T02:46:20.817ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7772024-12-21T02:46:20.850ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7782024-12-21T02:46:20.851ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7792024-12-21T02:46:20.851ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7802024-12-21T02:46:20.881ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 4bf02835-271c-4b1b-a7ae-b005eed1920c (service), filesystem_pool: Some(ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: fb98f734-c99a-4ecb-bba3-508a9b86a289 (service), filesystem_pool: Some(ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: da604828-d4f1-4898-b180-39aa8632768d (service), filesystem_pool: Some(ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 281bf158-86ef-4d41-a3cd-6b02a5cb6c14 (service), filesystem_pool: Some(ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 23fed39a-8fa7-4bb1-91b9-60dcc1ef675a, kind: Service { id: 281bf158-86ef-4d41-a3cd-6b02a5cb6c14 }, name: Name("ntp-281bf158-86ef-4d41-a3cd-6b02a5cb6c14"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 78])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7812024-12-21T02:46:20.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64934
7822024-12-21T02:46:20.882ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832024-12-21T02:46:20.882ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842024-12-21T02:46:20.892ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852024-12-21T02:46:20.892ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862024-12-21T02:46:20.902ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7872024-12-21T02:46:20.902ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7882024-12-21T02:46:20.911ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7892024-12-21T02:46:20.911ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/omicron-zones.json file = common/src/ledger.rs:177
7902024-12-21T02:46:20.911ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/omicron-zones.json file = common/src/ledger.rs:177
7912024-12-21T02:46:20.911ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7922024-12-21T02:46:20.921ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7932024-12-21T02:46:20.953ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7942024-12-21T02:46:20.954ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7952024-12-21T02:46:20.954ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7962024-12-21T02:46:20.984ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 245, 78]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7972024-12-21T02:46:20.984ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7982024-12-21T02:46:20.984ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7992024-12-21T02:46:20.984ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
8002024-12-21T02:46:20.985ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
8012024-12-21T02:46:20.985ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8022024-12-21T02:46:21.009ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14 file = illumos-utils/src/zone.rs:325
8032024-12-21T02:46:21.028ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14 file = illumos-utils/src/zone.rs:363
8042024-12-21T02:46:21.653ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8052024-12-21T02:46:21.653ZINFOSledAgent (ServiceManager): Booting oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14
8062024-12-21T02:46:21.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14") failed: Property not found. retry in 63.364623ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14
8072024-12-21T02:46:21.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14") failed: Property not found. retry in 99.762614ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14
8082024-12-21T02:46:21.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14") failed: Property not found. retry in 130.945592ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14
8092024-12-21T02:46:22.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14") failed: Property not found. retry in 251.674951ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14
8102024-12-21T02:46:22.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14") failed: Property not found. retry in 693.768053ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14
8112024-12-21T02:46:23.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14") failed: Property not found. retry in 1.049873539s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14
8122024-12-21T02:46:24.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14") failed: Property not found. retry in 723.613272ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14
8132024-12-21T02:46:24.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14") failed: Property not found. retry in 1.028202277s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14
8142024-12-21T02:46:25.124ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10298858320280328207 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8152024-12-21T02:46:25.124ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8787551135208442133 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8162024-12-21T02:46:25.405ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) file = sled-agent/src/nexus.rs:527 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8172024-12-21T02:46:25.562ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16040429980454400900 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8182024-12-21T02:46:25.562ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8637994223622190982 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8192024-12-21T02:46:25.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14") failed: Property not found. retry in 697.568202ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14
8202024-12-21T02:46:26.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14") failed: Property not found. retry in 822.699004ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14
8212024-12-21T02:46:27.461ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14
8222024-12-21T02:46:27.461ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8232024-12-21T02:46:27.461ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8242024-12-21T02:46:27.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6580300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:64934 req_id = 7863659e-b278-4a52-b21a-3c0f8c8e12d3 response_code = 204 uri = /omicron-zones
8252024-12-21T02:46:27.464ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8262024-12-21T02:46:27.494ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8272024-12-21T02:46:27.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33794
8282024-12-21T02:46:27.503ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8292024-12-21T02:46:27.504ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33794 req_id = 1705a352-5340-4d59-a55a-9f44d1002b5d response_code = 500 uri = /timesync
8302024-12-21T02:46:27.506ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8312024-12-21T02:46:27.619ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8322024-12-21T02:46:27.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48756
8332024-12-21T02:46:29.861ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5915962094045573163 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8342024-12-21T02:46:30.293ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4680822247801973569 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8352024-12-21T02:46:30.296ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2878915270723471170 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8362024-12-21T02:46:31.628ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8372024-12-21T02:46:31.628ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008590 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48756 req_id = 7d156379-ca63-404f-88f3-92d99e190514 response_code = 500 uri = /timesync
8382024-12-21T02:46:31.630ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8392024-12-21T02:46:31.744ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8402024-12-21T02:46:31.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47824
8412024-12-21T02:46:31.752ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8422024-12-21T02:46:31.752ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 7926 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47824 req_id = 92c6e3c3-b576-45d1-8694-fd38ac313ef4 response_code = 500 uri = /timesync
8432024-12-21T02:46:31.755ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8442024-12-21T02:46:31.938ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8452024-12-21T02:46:31.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52868
8462024-12-21T02:46:36.087ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10298858320280328207 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8472024-12-21T02:46:36.088ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8787551135208442133 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8482024-12-21T02:46:36.523ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16040429980454400900 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8492024-12-21T02:46:36.523ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8637994223622190982 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8502024-12-21T02:46:36.907ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_281bf158-86ef-4d41-a3cd-6b02a5cb6c14': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8512024-12-21T02:46:36.907ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009363 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52868 req_id = ed12a8b5-ce36-4bc9-97a0-ebcd8c324888 response_code = 500 uri = /timesync
8522024-12-21T02:46:36.909ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8532024-12-21T02:46:37.190ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8542024-12-21T02:46:37.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34356
8552024-12-21T02:46:37.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34356 req_id = d23fdfe5-de68-430e-8d19-2c11b2219ec7 response_code = 200 uri = /timesync
8562024-12-21T02:46:37.201ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.311425358 } file = sled-agent/src/rack_setup/service.rs:743
8572024-12-21T02:46:37.201ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582024-12-21T02:46:37.481ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8592024-12-21T02:46:37.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45824
8602024-12-21T02:46:37.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8757 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45824 req_id = 2df70cf1-140a-46e2-a5b6-4bef753ce9f7 response_code = 200 uri = /timesync
8612024-12-21T02:46:37.492ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.311850727 } file = sled-agent/src/rack_setup/service.rs:743
8622024-12-21T02:46:37.492ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8632024-12-21T02:46:37.837ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8642024-12-21T02:46:37.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33301
8652024-12-21T02:46:37.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33301 req_id = a90f8f81-ce50-40d2-aebb-7f8ae21bb53d response_code = 200 uri = /timesync
8662024-12-21T02:46:37.847ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.310886323 } file = sled-agent/src/rack_setup/service.rs:743
8672024-12-21T02:46:37.847ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8682024-12-21T02:46:38.186ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8692024-12-21T02:46:38.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49955
8702024-12-21T02:46:38.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8907 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49955 req_id = d0025dc5-208b-488b-9197-2b5c5160cb62 response_code = 200 uri = /timesync
8712024-12-21T02:46:38.197ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.309937119 } file = sled-agent/src/rack_setup/service.rs:743
8722024-12-21T02:46:38.197ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8732024-12-21T02:46:38.443ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8742024-12-21T02:46:38.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59692
8752024-12-21T02:46:38.447ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14271165847003169805 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8762024-12-21T02:46:38.448ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7631932193072109436 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8772024-12-21T02:46:38.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59692 req_id = 420476bc-f016-4122-bf09-582360cf94e3 response_code = 200 uri = /timesync
8782024-12-21T02:46:38.453ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3454618057, ip_addr: 205.233.73.201, stratum: 4, ref_time: 1734749197.8242505, correction: -0.30770281 } file = sled-agent/src/rack_setup/service.rs:743
8792024-12-21T02:46:38.453ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8802024-12-21T02:46:38.961ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8812024-12-21T02:46:38.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50762
8822024-12-21T02:46:38.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50762 req_id = 55994f41-ac20-441d-94c9-c9769145fb51 response_code = 200 uri = /timesync
8832024-12-21T02:46:38.972ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734749197.3601494, correction: -0.306296527 } file = sled-agent/src/rack_setup/service.rs:743
8842024-12-21T02:46:38.972ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8852024-12-21T02:46:39.762ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8862024-12-21T02:46:39.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51268
8872024-12-21T02:46:39.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9606 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51268 req_id = a0082b51-b141-4c6b-b1ee-9fd6d9ee626f response_code = 200 uri = /timesync
8882024-12-21T02:46:39.773ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734749197.3601494, correction: -0.303144038 } file = sled-agent/src/rack_setup/service.rs:743
8892024-12-21T02:46:39.773ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8902024-12-21T02:46:40.278ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8912024-12-21T02:46:40.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40984
8922024-12-21T02:46:40.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8680 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40984 req_id = 52844b68-98a9-4e08-ac6a-c8f774b0f0a1 response_code = 200 uri = /timesync
8932024-12-21T02:46:40.290ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734749197.3601494, correction: -0.301743418 } file = sled-agent/src/rack_setup/service.rs:743
8942024-12-21T02:46:40.290ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8952024-12-21T02:46:40.811ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5915962094045573163 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8962024-12-21T02:46:40.989ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 202.888105ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
8972024-12-21T02:46:41.152ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8982024-12-21T02:46:41.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37862
8992024-12-21T02:46:41.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8928 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37862 req_id = aae202ad-185b-4d00-8284-0b771779448e response_code = 200 uri = /timesync
9002024-12-21T02:46:41.163ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3454618057, ip_addr: 205.233.73.201, stratum: 4, ref_time: 1734749199.2206614, correction: -0.297745824 } file = sled-agent/src/rack_setup/service.rs:743
9012024-12-21T02:46:41.163ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9022024-12-21T02:46:41.242ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4680822247801973569 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9032024-12-21T02:46:41.246ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2878915270723471170 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9042024-12-21T02:46:42.035ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9052024-12-21T02:46:42.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45578
9062024-12-21T02:46:42.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9098 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45578 req_id = 33169a12-897a-4077-a8a5-47d0b546d9a8 response_code = 200 uri = /timesync
9072024-12-21T02:46:42.047ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3454618057, ip_addr: 205.233.73.201, stratum: 4, ref_time: 1734749200.9869783, correction: -0.294860542 } file = sled-agent/src/rack_setup/service.rs:743
9082024-12-21T02:46:42.047ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9092024-12-21T02:46:43.192ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9102024-12-21T02:46:43.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53474
9112024-12-21T02:46:43.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8003 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53474 req_id = cdac0c81-6e44-4277-9115-6227cba5c78c response_code = 200 uri = /timesync
9122024-12-21T02:46:43.203ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3454618057, ip_addr: 205.233.73.201, stratum: 4, ref_time: 1734749201.2411747, correction: -0.291747242 } file = sled-agent/src/rack_setup/service.rs:743
9132024-12-21T02:46:43.203ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9142024-12-21T02:46:45.150ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9152024-12-21T02:46:45.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64840
9162024-12-21T02:46:45.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7773 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64840 req_id = bf2d99a1-84a6-4bd2-a811-473d2aa6b8b8 response_code = 200 uri = /timesync
9172024-12-21T02:46:45.161ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1734749204.1512148, correction: -0.286616862 } file = sled-agent/src/rack_setup/service.rs:743
9182024-12-21T02:46:45.161ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9192024-12-21T02:46:46.018ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37993
9202024-12-21T02:46:46.019ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37993 req_id = b223b753-9675-41bf-bb9c-265bb6029436 response_code = 200 uri = /baseboard
9212024-12-21T02:46:46.062ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10298858320280328207 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9222024-12-21T02:46:46.062ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8787551135208442133 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9232024-12-21T02:46:46.320ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9242024-12-21T02:46:46.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37655
9252024-12-21T02:46:46.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8755 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37655 req_id = 81fb3688-f12b-4c33-b067-41faf764c83d response_code = 200 uri = /timesync
9262024-12-21T02:46:46.333ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1734749205.0704482, correction: -0.283430994 } file = sled-agent/src/rack_setup/service.rs:743
9272024-12-21T02:46:46.333ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9282024-12-21T02:46:46.498ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16040429980454400900 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9292024-12-21T02:46:46.498ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8637994223622190982 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9302024-12-21T02:46:47.341ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9312024-12-21T02:46:47.341ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38534
9322024-12-21T02:46:47.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8926 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38534 req_id = 3596dd1c-1d39-4dce-b9ba-1e848a93a799 response_code = 200 uri = /timesync
9332024-12-21T02:46:47.352ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1734749206.465313, correction: -0.280695051 } file = sled-agent/src/rack_setup/service.rs:743
9342024-12-21T02:46:47.352ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9352024-12-21T02:46:48.422ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14271165847003169805 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9362024-12-21T02:46:48.422ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7631932193072109436 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9372024-12-21T02:46:49.676ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9382024-12-21T02:46:49.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39619
9392024-12-21T02:46:49.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8991 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39619 req_id = 6b798454-3b6f-47fc-a3fa-1e83110d2e3b response_code = 200 uri = /timesync
9402024-12-21T02:46:49.688ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1734749207.884741, correction: -0.274264425 } file = sled-agent/src/rack_setup/service.rs:743
9412024-12-21T02:46:49.688ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9422024-12-21T02:46:50.787ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5915962094045573163 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9432024-12-21T02:46:51.249ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9442024-12-21T02:46:51.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49579
9452024-12-21T02:46:51.250ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4680822247801973569 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9462024-12-21T02:46:51.250ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2878915270723471170 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9472024-12-21T02:46:51.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49579 req_id = e34603e2-7476-4296-bbe3-dc70b8ebdea4 response_code = 200 uri = /timesync
9482024-12-21T02:46:51.261ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1734749210.4802804, correction: -0.270002991 } file = sled-agent/src/rack_setup/service.rs:743
9492024-12-21T02:46:51.261ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9502024-12-21T02:46:53.755ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9512024-12-21T02:46:53.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43504
9522024-12-21T02:46:53.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8636 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43504 req_id = a2f8fd13-c574-4d43-8c11-e9dec6f1f9e3 response_code = 200 uri = /timesync
9532024-12-21T02:46:53.766ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1734749212.470707, correction: -0.26317212 } file = sled-agent/src/rack_setup/service.rs:743
9542024-12-21T02:46:53.766ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9552024-12-21T02:46:56.037ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10298858320280328207 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9562024-12-21T02:46:56.037ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8787551135208442133 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9572024-12-21T02:46:56.188ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 319.60718ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9582024-12-21T02:46:56.472ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16040429980454400900 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9592024-12-21T02:46:56.472ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8637994223622190982 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9602024-12-21T02:46:58.006ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9612024-12-21T02:46:58.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45284
9622024-12-21T02:46:58.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45284 req_id = 57db1587-f7db-461c-b6d6-09f31e490828 response_code = 200 uri = /timesync
9632024-12-21T02:46:58.019ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1734749217.054033, correction: -0.251605034 } file = sled-agent/src/rack_setup/service.rs:743
9642024-12-21T02:46:58.019ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9652024-12-21T02:46:58.398ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14271165847003169805 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9662024-12-21T02:46:58.398ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7631932193072109436 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9672024-12-21T02:47:00.763ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5915962094045573163 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9682024-12-21T02:47:01.224ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4680822247801973569 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9692024-12-21T02:47:01.224ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2878915270723471170 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9702024-12-21T02:47:02.769ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9712024-12-21T02:47:02.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65504
9722024-12-21T02:47:02.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65504 req_id = c59bc5eb-56a8-426d-8866-2491e38f5aa5 response_code = 200 uri = /timesync
9732024-12-21T02:47:02.781ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1734749221.6447046, correction: -0.23866418 } file = sled-agent/src/rack_setup/service.rs:743
9742024-12-21T02:47:02.781ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9752024-12-21T02:47:06.012ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 10298858320280328207 reason = Duration(60s) sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9762024-12-21T02:47:06.013ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8787551135208442133 reason = Duration(60s) sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9772024-12-21T02:47:06.446ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16040429980454400900 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9782024-12-21T02:47:06.446ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8637994223622190982 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9792024-12-21T02:47:08.374ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14271165847003169805 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9802024-12-21T02:47:08.374ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7631932193072109436 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9812024-12-21T02:47:09.393ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9822024-12-21T02:47:09.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36981
9832024-12-21T02:47:09.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9654 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36981 req_id = addbdaf7-3261-40d1-83ff-68b70329a702 response_code = 200 uri = /timesync
9842024-12-21T02:47:09.406ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1734749228.0714903, correction: -0.220641598 } file = sled-agent/src/rack_setup/service.rs:743
9852024-12-21T02:47:09.406ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9862024-12-21T02:47:10.738ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5915962094045573163 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9872024-12-21T02:47:11.199ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4680822247801973569 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9882024-12-21T02:47:11.199ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2878915270723471170 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9892024-12-21T02:47:11.501ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.475996689s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9902024-12-21T02:47:12.865ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9912024-12-21T02:47:12.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50301
9922024-12-21T02:47:12.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9015 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50301 req_id = e1c6aa5d-b821-4a7f-98e3-b4a9c97cde95 response_code = 200 uri = /timesync
9932024-12-21T02:47:12.877ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1734749231.149222, correction: -0.211228117 } file = sled-agent/src/rack_setup/service.rs:743
9942024-12-21T02:47:12.877ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9952024-12-21T02:47:15.971ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54848
9962024-12-21T02:47:15.971ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54848 req_id = b9cb58d8-70aa-49cc-a00a-8aa114386648 response_code = 200 uri = /baseboard
9972024-12-21T02:47:16.421ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16040429980454400900 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9982024-12-21T02:47:16.421ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8637994223622190982 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
9992024-12-21T02:47:18.232ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10002024-12-21T02:47:18.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47714
10012024-12-21T02:47:18.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8619 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47714 req_id = 65e2c46d-87c0-41a4-8ece-4fa2382e9756 response_code = 200 uri = /timesync
10022024-12-21T02:47:18.245ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1734749236.3827937, correction: -0.196661219 } file = sled-agent/src/rack_setup/service.rs:743
10032024-12-21T02:47:18.245ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10042024-12-21T02:47:18.350ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14271165847003169805 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10052024-12-21T02:47:18.350ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7631932193072109436 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10062024-12-21T02:47:20.713ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 5915962094045573163 reason = Duration(60s) sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10072024-12-21T02:47:21.174ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4680822247801973569 reason = Duration(60s) sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10082024-12-21T02:47:21.174ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 2878915270723471170 reason = Duration(60s) sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10092024-12-21T02:47:26.397ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16040429980454400900 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10102024-12-21T02:47:26.397ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8637994223622190982 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10112024-12-21T02:47:27.969ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.441022828s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10122024-12-21T02:47:28.325ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 14271165847003169805 reason = Duration(60s) sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10132024-12-21T02:47:28.325ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 7631932193072109436 reason = Duration(60s) sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10142024-12-21T02:47:29.076ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10152024-12-21T02:47:29.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63925
10162024-12-21T02:47:29.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8884 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63925 req_id = 9d95e037-cd7d-4705-bee9-8ffbe45db885 response_code = 200 uri = /timesync
10172024-12-21T02:47:29.090ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1734749246.032904, correction: -0.167112797 } file = sled-agent/src/rack_setup/service.rs:743
10182024-12-21T02:47:29.090ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10192024-12-21T02:47:36.372ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16040429980454400900 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10202024-12-21T02:47:36.372ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8637994223622190982 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10212024-12-21T02:47:39.077ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10222024-12-21T02:47:39.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48668
10232024-12-21T02:47:39.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8394 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48668 req_id = b2205ac7-c339-482e-aa8e-12bdb18bb9e4 response_code = 200 uri = /timesync
10242024-12-21T02:47:39.088ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1734749254.7364814, correction: -0.139797509 } file = sled-agent/src/rack_setup/service.rs:743
10252024-12-21T02:47:39.088ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10262024-12-21T02:47:44.401ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.557994792s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10272024-12-21T02:47:45.923ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63925
10282024-12-21T02:47:45.923ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63925 req_id = 614fc9ac-2b79-487d-952d-b9b4864c6ffa response_code = 200 uri = /baseboard
10292024-12-21T02:47:46.347ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16040429980454400900 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10302024-12-21T02:47:46.347ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8637994223622190982 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10312024-12-21T02:47:54.143ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10322024-12-21T02:47:54.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41384
10332024-12-21T02:47:54.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7a7e1eb3-5b3f-4644-a8aa-5f55f0bbe085 response_code = 200 uri = /timesync
10342024-12-21T02:47:54.155ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1734749271.116146, correction: -0.098882414 } file = sled-agent/src/rack_setup/service.rs:743
10352024-12-21T02:47:54.155ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10362024-12-21T02:47:56.322ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16040429980454400900 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10372024-12-21T02:47:56.323ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8637994223622190982 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10382024-12-21T02:48:02.944ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 6.25114224s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10392024-12-21T02:48:06.298ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16040429980454400900 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10402024-12-21T02:48:06.298ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8637994223622190982 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10412024-12-21T02:48:12.125ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10422024-12-21T02:48:12.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45217
10432024-12-21T02:48:12.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45217 req_id = aac1aff8-bbb8-4fa2-ace7-62c06841a9f5 response_code = 200 uri = /timesync
10442024-12-21T02:48:12.137ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1734749287.422124, correction: -0.050066244 } file = sled-agent/src/rack_setup/service.rs:743
10452024-12-21T02:48:12.137ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10462024-12-21T02:48:15.874ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58385
10472024-12-21T02:48:15.874ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58385 req_id = be2dd699-fef7-4c05-ab2b-24c5197a8aa3 response_code = 200 uri = /baseboard
10482024-12-21T02:48:16.273ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16040429980454400900 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10492024-12-21T02:48:16.273ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8637994223622190982 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10502024-12-21T02:48:24.173ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.364429802s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10512024-12-21T02:48:25.439ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10522024-12-21T02:48:25.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50460
10532024-12-21T02:48:25.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20529 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50460 req_id = c6b6a06f-34d7-4218-a0bb-8f2d12e73019 response_code = 200 uri = /timesync
10542024-12-21T02:48:25.459ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T02:47:21.174226196Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4680822247801973569 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10552024-12-21T02:48:25.461ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T02:47:06.012418218Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 10298858320280328207 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10562024-12-21T02:48:25.461ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T02:47:20.713686317Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 5915962094045573163 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10572024-12-21T02:48:25.461ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T02:47:28.325383189Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 14271165847003169805 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10582024-12-21T02:48:25.462ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T02:47:28.325646012Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 7631932193072109436 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10592024-12-21T02:48:25.462ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T02:47:06.013037488Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8787551135208442133 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10602024-12-21T02:48:25.463ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T02:47:21.174572100Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 2878915270723471170 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
10612024-12-21T02:48:25.465ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1734749303.0631173, correction: -0.01389352 } file = sled-agent/src/rack_setup/service.rs:743
10622024-12-21T02:48:25.465ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
10632024-12-21T02:48:25.496ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 4bf02835-271c-4b1b-a7ae-b005eed1920c (service), filesystem_pool: Some(ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: fb98f734-c99a-4ecb-bba3-508a9b86a289 (service), filesystem_pool: Some(ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: da604828-d4f1-4898-b180-39aa8632768d (service), filesystem_pool: Some(ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 281bf158-86ef-4d41-a3cd-6b02a5cb6c14 (service), filesystem_pool: Some(ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 23fed39a-8fa7-4bb1-91b9-60dcc1ef675a, kind: Service { id: 281bf158-86ef-4d41-a3cd-6b02a5cb6c14 }, name: Name("ntp-281bf158-86ef-4d41-a3cd-6b02a5cb6c14"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 78])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 664ff113-c007-4c20-b10a-4ac6ec3c8b33 (service), filesystem_pool: Some(ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External } } } }, OmicronZoneConfig { id: 35d2b885-f79c-48e4-8c46-dc1e3a65f7bf (service), filesystem_pool: Some(ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1f91b54c-749d-45e1-b9b1-9e158545f53f (service), filesystem_pool: Some(ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 73d4f97d-6cf7-4b31-8e88-3c150f1fed7d (service), filesystem_pool: Some(ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External } } } }, OmicronZoneConfig { id: 7723981e-7406-4ed4-8fa9-b578dbea9bf3 (service), filesystem_pool: Some(ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10642024-12-21T02:48:25.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60425
10652024-12-21T02:48:25.496ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10662024-12-21T02:48:25.496ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10672024-12-21T02:48:25.506ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10682024-12-21T02:48:25.506ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10692024-12-21T02:48:25.516ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10702024-12-21T02:48:25.516ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10712024-12-21T02:48:25.526ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10722024-12-21T02:48:25.526ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10732024-12-21T02:48:25.535ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10742024-12-21T02:48:25.535ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10752024-12-21T02:48:25.545ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10762024-12-21T02:48:25.545ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10772024-12-21T02:48:25.555ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10782024-12-21T02:48:25.555ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: Cockroach }, responder: ... }
10792024-12-21T02:48:25.563ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10802024-12-21T02:48:25.563ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10812024-12-21T02:48:25.572ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10822024-12-21T02:48:25.572ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/omicron-zones.json file = common/src/ledger.rs:177
10832024-12-21T02:48:25.572ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/omicron-zones.json file = common/src/ledger.rs:177
10842024-12-21T02:48:25.572ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10852024-12-21T02:48:25.656ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10862024-12-21T02:48:25.656ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10872024-12-21T02:48:25.656ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10882024-12-21T02:48:25.656ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10892024-12-21T02:48:25.656ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10902024-12-21T02:48:25.747ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d file = illumos-utils/src/zone.rs:325
10912024-12-21T02:48:25.751ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33 file = illumos-utils/src/zone.rs:325
10922024-12-21T02:48:25.755ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f file = illumos-utils/src/zone.rs:325
10932024-12-21T02:48:25.759ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf file = illumos-utils/src/zone.rs:325
10942024-12-21T02:48:25.763ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3 file = illumos-utils/src/zone.rs:325
10952024-12-21T02:48:25.768ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d file = illumos-utils/src/zone.rs:363
10962024-12-21T02:48:25.773ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33 file = illumos-utils/src/zone.rs:363
10972024-12-21T02:48:25.777ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f file = illumos-utils/src/zone.rs:363
10982024-12-21T02:48:25.782ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf file = illumos-utils/src/zone.rs:363
10992024-12-21T02:48:25.787ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3 file = illumos-utils/src/zone.rs:363
11002024-12-21T02:48:29.125ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1f91b54c-749d-45e1-b9b1-9e158545f53f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11012024-12-21T02:48:29.125ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f
11022024-12-21T02:48:29.139ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='664ff113-c007-4c20-b10a-4ac6ec3c8b33'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11032024-12-21T02:48:29.140ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7723981e-7406-4ed4-8fa9-b578dbea9bf3'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11042024-12-21T02:48:29.140ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33
11052024-12-21T02:48:29.145ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3
11062024-12-21T02:48:29.200ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='73d4f97d-6cf7-4b31-8e88-3c150f1fed7d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11072024-12-21T02:48:29.200ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d
11082024-12-21T02:48:29.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f") failed: Property not found. retry in 29.438059ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f
11092024-12-21T02:48:29.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33") failed: Property not found. retry in 28.823975ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33
11102024-12-21T02:48:29.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3") failed: Property not found. retry in 55.266148ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3
11112024-12-21T02:48:29.292ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='35d2b885-f79c-48e4-8c46-dc1e3a65f7bf'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11122024-12-21T02:48:29.292ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf
11132024-12-21T02:48:29.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f") failed: Property not found. retry in 98.992382ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f
11142024-12-21T02:48:29.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33") failed: Property not found. retry in 123.012425ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33
11152024-12-21T02:48:29.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d") failed: Property not found. retry in 31.738694ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d
11162024-12-21T02:48:29.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3") failed: Property not found. retry in 120.3942ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3
11172024-12-21T02:48:29.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d") failed: Property not found. retry in 132.246691ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d
11182024-12-21T02:48:29.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33") failed: Property not found. retry in 242.340667ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33
11192024-12-21T02:48:29.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f") failed: Property not found. retry in 202.677542ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f
11202024-12-21T02:48:30.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3") failed: Property not found. retry in 130.349296ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3
11212024-12-21T02:48:30.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d") failed: Property not found. retry in 292.589761ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d
11222024-12-21T02:48:30.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf") failed: Property not found. retry in 39.567431ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf
11232024-12-21T02:48:30.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33") failed: Property not found. retry in 204.014278ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33
11242024-12-21T02:48:30.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf") failed: Property not found. retry in 128.681057ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf
11252024-12-21T02:48:30.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3") failed: Property not found. retry in 573.639781ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3
11262024-12-21T02:48:30.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f") failed: Property not found. retry in 442.39139ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f
11272024-12-21T02:48:30.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf") failed: Property not found. retry in 283.179294ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf
11282024-12-21T02:48:30.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d") failed: Property not found. retry in 350.325491ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d
11292024-12-21T02:48:30.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33") failed: Property not found. retry in 1.118271699s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33
11302024-12-21T02:48:30.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf") failed: Property not found. retry in 257.734509ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf
11312024-12-21T02:48:30.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f") failed: Property not found. retry in 534.77444ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f
11322024-12-21T02:48:30.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3") failed: Property not found. retry in 1.160685723s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3
11332024-12-21T02:48:30.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d") failed: Property not found. retry in 723.434647ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d
11342024-12-21T02:48:30.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf") failed: Property not found. retry in 1.053666005s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf
11352024-12-21T02:48:31.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f") failed: Property not found. retry in 777.48468ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f
11362024-12-21T02:48:31.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d") failed: Property not found. retry in 784.98454ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d
11372024-12-21T02:48:31.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33") failed: Property not found. retry in 1.034168052s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33
11382024-12-21T02:48:31.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3") failed: Property not found. retry in 1.383163437s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3
11392024-12-21T02:48:32.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf") failed: Property not found. retry in 1.260373506s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf
11402024-12-21T02:48:32.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f") failed: Property not found. retry in 1.409967323s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f
11412024-12-21T02:48:32.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d") failed: Property not found. retry in 1.127847944s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d
11422024-12-21T02:48:32.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33") failed: Property not found. retry in 1.456759598s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33
11432024-12-21T02:48:33.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf") failed: Property not found. retry in 1.105639091s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf
11442024-12-21T02:48:33.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3") failed: Property not found. retry in 748.335728ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3
11452024-12-21T02:48:33.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d") failed: Property not found. retry in 1.130756186s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d
11462024-12-21T02:48:33.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f") failed: Property not found. retry in 1.406789961s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f
11472024-12-21T02:48:34.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33") failed: Property not found. retry in 1.375304209s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33
11482024-12-21T02:48:34.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3") failed: Property not found. retry in 1.497579531s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3
11492024-12-21T02:48:34.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf") failed: Property not found. retry in 1.164669803s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf
11502024-12-21T02:48:34.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d") failed: Property not found. retry in 937.297386ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d
11512024-12-21T02:48:34.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f") failed: Property not found. retry in 1.402527377s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f
11522024-12-21T02:48:35.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33") failed: Property not found. retry in 1.099563163s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33
11532024-12-21T02:48:35.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d") failed: Property not found. retry in 1.108311806s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d
11542024-12-21T02:48:35.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3") failed: Property not found. retry in 1.257390537s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3
11552024-12-21T02:48:35.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf") failed: Property not found. retry in 1.329482701s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf
11562024-12-21T02:48:36.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f") failed: Property not found. retry in 1.338379718s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f
11572024-12-21T02:48:36.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33") failed: Property not found. retry in 1.309078135s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33
11582024-12-21T02:48:36.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d") failed: Property not found. retry in 1.035413236s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d
11592024-12-21T02:48:36.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3") failed: Property not found. retry in 880.663291ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3
11602024-12-21T02:48:36.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf") failed: Property not found. retry in 939.027083ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf
11612024-12-21T02:48:37.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f") failed: Property not found. retry in 962.579573ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f
11622024-12-21T02:48:37.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d") failed: Property not found. retry in 911.872236ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d
11632024-12-21T02:48:37.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3") failed: Property not found. retry in 687.392874ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3
11642024-12-21T02:48:37.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33") failed: Property not found. retry in 623.224771ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33
11652024-12-21T02:48:37.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf") failed: Property not found. retry in 829.144544ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf
11662024-12-21T02:48:38.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3") failed: Property not found. retry in 698.496028ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3
11672024-12-21T02:48:38.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33") failed: Property not found. retry in 1.452899448s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33
11682024-12-21T02:48:38.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d") failed: Property not found. retry in 1.478088962s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d
11692024-12-21T02:48:38.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f") failed: Property not found. retry in 783.023791ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f
11702024-12-21T02:48:38.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf") failed: Property not found. retry in 1.301050647s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf
11712024-12-21T02:48:39.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3") failed: Property not found. retry in 1.234633223s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3
11722024-12-21T02:48:40.432ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_73d4f97d-6cf7-4b31-8e88-3c150f1fed7d
11732024-12-21T02:48:40.432ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_664ff113-c007-4c20-b10a-4ac6ec3c8b33
11742024-12-21T02:48:40.432ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f
11752024-12-21T02:48:40.432ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_35d2b885-f79c-48e4-8c46-dc1e3a65f7bf
11762024-12-21T02:48:40.432ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_7723981e-7406-4ed4-8fa9-b578dbea9bf3
11772024-12-21T02:48:40.432ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11782024-12-21T02:48:40.432ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11792024-12-21T02:48:40.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14951586 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60425 req_id = 1b281928-0a21-41e1-9346-2adaddc45a0c response_code = 204 uri = /omicron-zones
11802024-12-21T02:48:40.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40183
11812024-12-21T02:48:40.497ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 30684 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40183 req_id = f7239bc9-b8c5-4616-9085-40df189c5948 response_code = 500 uri = /cockroachdb
11822024-12-21T02:48:40.497ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f7239bc9-b8c5-4616-9085-40df189c5948", "content-length": "124", "date": "Sat, 21 Dec 2024 02:48:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f7239bc9-b8c5-4616-9085-40df189c5948" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 55.104569ms
11832024-12-21T02:48:40.583ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29012 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40183 req_id = 0ab312af-5cce-4125-a087-2b1957d3240f response_code = 500 uri = /cockroachdb
11842024-12-21T02:48:40.583ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0ab312af-5cce-4125-a087-2b1957d3240f", "content-length": "124", "date": "Sat, 21 Dec 2024 02:48:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0ab312af-5cce-4125-a087-2b1957d3240f" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 95.343902ms
11852024-12-21T02:48:40.707ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27620 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40183 req_id = 44206d18-1018-49c8-8b41-f7379d5be3cb response_code = 500 uri = /cockroachdb
11862024-12-21T02:48:40.707ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "44206d18-1018-49c8-8b41-f7379d5be3cb", "content-length": "124", "date": "Sat, 21 Dec 2024 02:48:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "44206d18-1018-49c8-8b41-f7379d5be3cb" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 153.748891ms
11872024-12-21T02:48:40.891ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28927 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40183 req_id = 1356919e-cc0e-4c7d-aa2e-3b0fc1a1801b response_code = 500 uri = /cockroachdb
11882024-12-21T02:48:40.891ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1356919e-cc0e-4c7d-aa2e-3b0fc1a1801b", "content-length": "124", "date": "Sat, 21 Dec 2024 02:48:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1356919e-cc0e-4c7d-aa2e-3b0fc1a1801b" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 101.608331ms
11892024-12-21T02:48:41.019ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25123 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40183 req_id = 6cf87667-a0e3-4069-8a01-94715a4b1d3f response_code = 500 uri = /cockroachdb
11902024-12-21T02:48:41.019ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6cf87667-a0e3-4069-8a01-94715a4b1d3f", "content-length": "124", "date": "Sat, 21 Dec 2024 02:48:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6cf87667-a0e3-4069-8a01-94715a4b1d3f" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 112.378352ms
11912024-12-21T02:48:41.160ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26007 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40183 req_id = d69cd216-dcce-4984-bc08-e520a94d703a response_code = 500 uri = /cockroachdb
11922024-12-21T02:48:41.160ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d69cd216-dcce-4984-bc08-e520a94d703a", "content-length": "124", "date": "Sat, 21 Dec 2024 02:48:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d69cd216-dcce-4984-bc08-e520a94d703a" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 153.5412ms
11932024-12-21T02:48:41.352ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1f91b54c-749d-45e1-b9b1-9e158545f53f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 37156 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40183 req_id = 09380768-6557-4cc8-b9be-886722df5444 response_code = 500 uri = /cockroachdb
11942024-12-21T02:48:41.352ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "09380768-6557-4cc8-b9be-886722df5444", "content-length": "124", "date": "Sat, 21 Dec 2024 02:48:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "09380768-6557-4cc8-b9be-886722df5444" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 380.875584ms
11952024-12-21T02:48:41.766ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3758
11962024-12-21T02:49:08.390ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3776
11972024-12-21T02:49:16.327ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3799
11982024-12-21T02:49:16.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34592734 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:40183 req_id = a31ea46d-71c1-4678-ac20-60600d3fbfd4 response_code = 204 uri = /cockroachdb
11992024-12-21T02:49:16.338ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 26.889365206s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
12002024-12-21T02:49:16.371ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 4bf02835-271c-4b1b-a7ae-b005eed1920c (service), filesystem_pool: Some(ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: fb98f734-c99a-4ecb-bba3-508a9b86a289 (service), filesystem_pool: Some(ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: da604828-d4f1-4898-b180-39aa8632768d (service), filesystem_pool: Some(ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 281bf158-86ef-4d41-a3cd-6b02a5cb6c14 (service), filesystem_pool: Some(ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 23fed39a-8fa7-4bb1-91b9-60dcc1ef675a, kind: Service { id: 281bf158-86ef-4d41-a3cd-6b02a5cb6c14 }, name: Name("ntp-281bf158-86ef-4d41-a3cd-6b02a5cb6c14"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 78])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 664ff113-c007-4c20-b10a-4ac6ec3c8b33 (service), filesystem_pool: Some(ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External } } } }, OmicronZoneConfig { id: 35d2b885-f79c-48e4-8c46-dc1e3a65f7bf (service), filesystem_pool: Some(ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1f91b54c-749d-45e1-b9b1-9e158545f53f (service), filesystem_pool: Some(ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 73d4f97d-6cf7-4b31-8e88-3c150f1fed7d (service), filesystem_pool: Some(ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External } } } }, OmicronZoneConfig { id: 7723981e-7406-4ed4-8fa9-b578dbea9bf3 (service), filesystem_pool: Some(ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External } } } }, OmicronZoneConfig { id: 82a0d97c-0396-4dff-a562-7bc3f12f4b4d (service), filesystem_pool: Some(ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: e6764d0d-89f4-4d8a-aa9a-63a6b6c44f9c, kind: Service { id: 82a0d97c-0396-4dff-a562-7bc3f12f4b4d }, name: Name("external-dns-82a0d97c-0396-4dff-a562-7bc3f12f4b4d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 117])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 7d789b63-e234-471f-abd5-426e10c5c6e3 (service), filesystem_pool: Some(ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: e7b4479d-d7bc-48c5-b3c2-7051533d16f5, kind: Service { id: 7d789b63-e234-471f-abd5-426e10c5c6e3 }, name: Name("external-dns-7d789b63-e234-471f-abd5-426e10c5c6e3"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 89])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 5f52ac53-51c8-4771-9e69-2b7ae5f68b33 (service), filesystem_pool: Some(ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 9382bc6b-4023-4b07-839c-d3afc84529d0, kind: Service { id: 5f52ac53-51c8-4771-9e69-2b7ae5f68b33 }, name: Name("nexus-5f52ac53-51c8-4771-9e69-2b7ae5f68b33"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 240])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: dcf56aa4-8d02-4872-82c4-3d769bb7bde8 (service), filesystem_pool: Some(ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: e6053b1c-903b-4570-b781-38175f6759a7, kind: Service { id: dcf56aa4-8d02-4872-82c4-3d769bb7bde8 }, name: Name("nexus-dcf56aa4-8d02-4872-82c4-3d769bb7bde8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 4f50fa81-5371-4a88-a8b4-4e3726e451a5 (service), filesystem_pool: Some(ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 86470b3f-1b5e-4e63-bb28-a8ff8c9cee13, kind: Service { id: 4f50fa81-5371-4a88-a8b4-4e3726e451a5 }, name: Name("nexus-4f50fa81-5371-4a88-a8b4-4e3726e451a5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: f33b7779-c528-4a50-88d2-df64a1c51a4f (service), filesystem_pool: Some(ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 0b390f7f-a043-488f-816f-887c9fdc5738 (service), filesystem_pool: Some(ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External } } } }, OmicronZoneConfig { id: 596122c8-db10-4efe-8fc6-817547aa5c5b (service), filesystem_pool: Some(ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: d7a4c825-8ff7-4c05-b91b-be54fad325d0 (service), filesystem_pool: Some(ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 5582a5e8-4d18-43d7-91c6-2d1f93c50727 (service), filesystem_pool: Some(ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 228b24aa-49c3-498e-abc2-ed3654961d5f (service), filesystem_pool: Some(ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External } } } }, OmicronZoneConfig { id: e1c39328-dcf4-4014-b8e4-04d473419416 (service), filesystem_pool: Some(ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External } } } }, OmicronZoneConfig { id: a67fcd8e-814b-49e1-b8bd-3e5612ba395e (service), filesystem_pool: Some(ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8404d553-7432-487e-b86a-f2936cc38dc9 (service), filesystem_pool: Some(ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External } } } }, OmicronZoneConfig { id: 66ae7088-b8a7-490b-a117-c5fd46b35110 (service), filesystem_pool: Some(ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External } } } }, OmicronZoneConfig { id: a26cf9be-8b60-4ac4-a6be-4413c28cf3ec (service), filesystem_pool: Some(ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5e04e3e8-5475-45b9-8405-9d7a27d9943c (service), filesystem_pool: Some(ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0a9a83a1-8dc9-4e39-82af-02dacafaf0cd (service), filesystem_pool: Some(ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External } } } }, OmicronZoneConfig { id: 75db992d-930a-40c5-8e96-16838343192b (service), filesystem_pool: Some(ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
12012024-12-21T02:49:16.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34470
12022024-12-21T02:49:16.374ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12032024-12-21T02:49:16.374ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12042024-12-21T02:49:16.390ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12052024-12-21T02:49:16.390ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12062024-12-21T02:49:16.401ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12072024-12-21T02:49:16.401ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12082024-12-21T02:49:16.410ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12092024-12-21T02:49:16.410ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12102024-12-21T02:49:16.420ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12112024-12-21T02:49:16.420ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12122024-12-21T02:49:16.429ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12132024-12-21T02:49:16.429ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12142024-12-21T02:49:16.438ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12152024-12-21T02:49:16.438ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: Cockroach }, responder: ... }
12162024-12-21T02:49:16.447ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12172024-12-21T02:49:16.447ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12182024-12-21T02:49:16.456ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12192024-12-21T02:49:16.456ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12202024-12-21T02:49:16.467ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12212024-12-21T02:49:16.467ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12222024-12-21T02:49:16.478ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
12232024-12-21T02:49:16.478ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12242024-12-21T02:49:16.489ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12252024-12-21T02:49:16.489ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, kind: Crucible }, responder: ... }
12262024-12-21T02:49:16.500ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12272024-12-21T02:49:16.500ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, kind: Crucible }, responder: ... }
12282024-12-21T02:49:16.509ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12292024-12-21T02:49:16.509ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, kind: Crucible }, responder: ... }
12302024-12-21T02:49:16.520ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12312024-12-21T02:49:16.520ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, kind: Crucible }, responder: ... }
12322024-12-21T02:49:16.529ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12332024-12-21T02:49:16.529ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, kind: Crucible }, responder: ... }
12342024-12-21T02:49:16.539ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12352024-12-21T02:49:16.539ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, kind: Crucible }, responder: ... }
12362024-12-21T02:49:16.549ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12372024-12-21T02:49:16.549ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, kind: Crucible }, responder: ... }
12382024-12-21T02:49:16.560ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12392024-12-21T02:49:16.560ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, kind: Crucible }, responder: ... }
12402024-12-21T02:49:16.571ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12412024-12-21T02:49:16.571ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, kind: Crucible }, responder: ... }
12422024-12-21T02:49:16.583ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12432024-12-21T02:49:16.583ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/omicron-zones.json file = common/src/ledger.rs:177
12442024-12-21T02:49:16.583ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/omicron-zones.json file = common/src/ledger.rs:177
12452024-12-21T02:49:16.584ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12462024-12-21T02:49:16.729ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12472024-12-21T02:49:16.730ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12482024-12-21T02:49:16.730ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12492024-12-21T02:49:16.743ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12502024-12-21T02:49:16.768ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12512024-12-21T02:49:16.769ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12522024-12-21T02:49:16.769ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12532024-12-21T02:49:16.782ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12542024-12-21T02:49:16.782ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12552024-12-21T02:49:16.783ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12562024-12-21T02:49:16.785ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12572024-12-21T02:49:16.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12582024-12-21T02:49:16.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12592024-12-21T02:49:16.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12602024-12-21T02:49:16.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12612024-12-21T02:49:16.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12622024-12-21T02:49:16.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12632024-12-21T02:49:16.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12642024-12-21T02:49:16.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12652024-12-21T02:49:16.966ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec file = illumos-utils/src/zone.rs:325
12662024-12-21T02:49:16.971ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_75db992d-930a-40c5-8e96-16838343192b file = illumos-utils/src/zone.rs:325
12672024-12-21T02:49:16.976ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f file = illumos-utils/src/zone.rs:325
12682024-12-21T02:49:16.982ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd file = illumos-utils/src/zone.rs:325
12692024-12-21T02:49:16.988ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416 file = illumos-utils/src/zone.rs:325
12702024-12-21T02:49:16.993ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f file = illumos-utils/src/zone.rs:325
12712024-12-21T02:49:17.167ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec file = illumos-utils/src/zone.rs:363
12722024-12-21T02:49:17.172ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_75db992d-930a-40c5-8e96-16838343192b file = illumos-utils/src/zone.rs:363
12732024-12-21T02:49:17.177ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f file = illumos-utils/src/zone.rs:363
12742024-12-21T02:49:17.181ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd file = illumos-utils/src/zone.rs:363
12752024-12-21T02:49:17.186ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416 file = illumos-utils/src/zone.rs:363
12762024-12-21T02:49:17.191ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f file = illumos-utils/src/zone.rs:363
12772024-12-21T02:49:17.196ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9 file = illumos-utils/src/zone.rs:325
12782024-12-21T02:49:17.201ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727 file = illumos-utils/src/zone.rs:325
12792024-12-21T02:49:17.206ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c file = illumos-utils/src/zone.rs:325
12802024-12-21T02:49:17.211ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e file = illumos-utils/src/zone.rs:325
12812024-12-21T02:49:17.216ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0 file = illumos-utils/src/zone.rs:325
12822024-12-21T02:49:17.222ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b file = illumos-utils/src/zone.rs:325
12832024-12-21T02:49:17.226ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738 file = illumos-utils/src/zone.rs:325
12842024-12-21T02:49:17.231ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110 file = illumos-utils/src/zone.rs:325
12852024-12-21T02:49:17.293ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12862024-12-21T02:49:17.347ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12872024-12-21T02:49:17.347ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9 file = illumos-utils/src/zone.rs:363
12882024-12-21T02:49:17.355ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727 file = illumos-utils/src/zone.rs:363
12892024-12-21T02:49:17.363ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c file = illumos-utils/src/zone.rs:363
12902024-12-21T02:49:17.370ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e file = illumos-utils/src/zone.rs:363
12912024-12-21T02:49:17.376ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0 file = illumos-utils/src/zone.rs:363
12922024-12-21T02:49:17.383ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b file = illumos-utils/src/zone.rs:363
12932024-12-21T02:49:17.390ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738 file = illumos-utils/src/zone.rs:363
12942024-12-21T02:49:17.398ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110 file = illumos-utils/src/zone.rs:363
12952024-12-21T02:49:17.459ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12962024-12-21T02:49:17.524ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12972024-12-21T02:49:17.592ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12982024-12-21T02:49:17.595ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12992024-12-21T02:49:17.595ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13002024-12-21T02:49:17.683ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 165, 117]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13012024-12-21T02:49:17.683ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
13022024-12-21T02:49:17.686ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13032024-12-21T02:49:17.686ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13042024-12-21T02:49:17.744ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 188, 127]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13052024-12-21T02:49:17.744ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
13062024-12-21T02:49:17.747ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13072024-12-21T02:49:17.747ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13082024-12-21T02:49:17.804ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 162, 89]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13092024-12-21T02:49:17.804ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
13102024-12-21T02:49:17.806ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13112024-12-21T02:49:17.806ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13122024-12-21T02:49:17.862ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 250, 240]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13132024-12-21T02:49:17.862ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
13142024-12-21T02:49:17.862ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
13152024-12-21T02:49:17.862ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
13162024-12-21T02:49:17.864ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13172024-12-21T02:49:17.864ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13182024-12-21T02:49:17.922ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 237, 75]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13192024-12-21T02:49:17.923ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
13202024-12-21T02:49:17.923ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
13212024-12-21T02:49:17.923ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
13222024-12-21T02:49:17.923ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
13232024-12-21T02:49:17.925ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13242024-12-21T02:49:17.925ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
13252024-12-21T02:49:17.928ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13262024-12-21T02:49:18.089ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
13272024-12-21T02:49:18.089ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
13282024-12-21T02:49:18.090ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
13292024-12-21T02:49:18.090ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
13302024-12-21T02:49:18.091ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5 file = illumos-utils/src/zone.rs:325
13312024-12-21T02:49:18.112ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
13322024-12-21T02:49:18.112ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
13332024-12-21T02:49:18.112ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d file = illumos-utils/src/zone.rs:325
13342024-12-21T02:49:18.126ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
13352024-12-21T02:49:18.131ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
13362024-12-21T02:49:18.136ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
13372024-12-21T02:49:18.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13382024-12-21T02:49:18.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13392024-12-21T02:49:18.139ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13402024-12-21T02:49:18.245ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5 file = illumos-utils/src/zone.rs:363
13412024-12-21T02:49:18.288ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d file = illumos-utils/src/zone.rs:363
13422024-12-21T02:49:18.296ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3 file = illumos-utils/src/zone.rs:325
13432024-12-21T02:49:18.303ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33 file = illumos-utils/src/zone.rs:325
13442024-12-21T02:49:18.309ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8 file = illumos-utils/src/zone.rs:325
13452024-12-21T02:49:18.326ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3 file = illumos-utils/src/zone.rs:363
13462024-12-21T02:49:18.334ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33 file = illumos-utils/src/zone.rs:363
13472024-12-21T02:49:18.340ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8 file = illumos-utils/src/zone.rs:363
13482024-12-21T02:49:19.244ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33149
13492024-12-21T02:49:19.245ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1723 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33149 req_id = 11e05b94-d1dc-4262-8703-953ee1b9e258 response_code = 200 uri = /baseboard
13502024-12-21T02:49:20.067ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13512024-12-21T02:49:20.070ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
13522024-12-21T02:49:20.206ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='6fa9ae2e-98fd-43bf-acb6-d3bac2058505'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13532024-12-21T02:49:20.212ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_81a0e2aa-7a9f-464b-aaff-78e01f8fe036/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='fd2ea8e6-8c77-4769-b693-1f3f345276d2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13542024-12-21T02:49:20.212ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a1307d86-524f-4687-99b5-553fb50f6ebe/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ba1e8ca7-5c3b-43ba-97ff-00853830c05a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13552024-12-21T02:49:20.212ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_63c9df44-0622-415c-a697-efc3e7bc6c27/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1748c0b1-df09-4e76-8987-0fa53c312e49'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13562024-12-21T02:49:20.212ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='39971a35-ba93-4c4d-8e88-f5288200e0fb'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13572024-12-21T02:49:20.212ZINFOSledAgent (ServiceManager): Booting oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
13582024-12-21T02:49:20.220ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_98af376c-57d5-4d4e-8868-ff737627f482/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='25ccc523-8c34-47f1-94f1-d09ac4f027de'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13592024-12-21T02:49:20.220ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
13602024-12-21T02:49:20.230ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
13612024-12-21T02:49:20.236ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
13622024-12-21T02:49:20.242ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
13632024-12-21T02:49:20.248ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
13642024-12-21T02:49:20.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 49.890922ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
13652024-12-21T02:49:20.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 58.68601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
13662024-12-21T02:49:20.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 39.27473ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
13672024-12-21T02:49:20.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 65.396119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
13682024-12-21T02:49:20.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 60.609787ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
13692024-12-21T02:49:20.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 43.212801ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
13702024-12-21T02:49:20.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 28.239387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
13712024-12-21T02:49:20.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 107.150145ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
13722024-12-21T02:49:20.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 99.130869ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
13732024-12-21T02:49:20.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 110.623362ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
13742024-12-21T02:49:20.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 61.046522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
13752024-12-21T02:49:20.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 111.388034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
13762024-12-21T02:49:20.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 82.866016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
13772024-12-21T02:49:20.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 59.626467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
13782024-12-21T02:49:20.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 163.919868ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
13792024-12-21T02:49:21.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 179.808428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
13802024-12-21T02:49:21.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 112.683234ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
13812024-12-21T02:49:21.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 185.785938ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
13822024-12-21T02:49:21.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 152.943958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
13832024-12-21T02:49:21.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 285.876565ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
13842024-12-21T02:49:21.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 171.902988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
13852024-12-21T02:49:21.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 557.573235ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
13862024-12-21T02:49:21.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 488.639032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
13872024-12-21T02:49:21.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 579.027962ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
13882024-12-21T02:49:21.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 525.115257ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
13892024-12-21T02:49:21.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 285.245516ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
13902024-12-21T02:49:21.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 448.703978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
13912024-12-21T02:49:21.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 422.534749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
13922024-12-21T02:49:21.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 717.999493ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
13932024-12-21T02:49:21.995ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13942024-12-21T02:49:21.996ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
13952024-12-21T02:49:22.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 561.737141ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
13962024-12-21T02:49:22.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 785.130433ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
13972024-12-21T02:49:22.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 491.180271ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
13982024-12-21T02:49:22.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 406.146153ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
13992024-12-21T02:49:22.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 857.675054ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
14002024-12-21T02:49:22.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 700.600994ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
14012024-12-21T02:49:22.203ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_75db992d-930a-40c5-8e96-16838343192b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='258d9c5e-f23d-4dda-aa41-411ff8a0e6a8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14022024-12-21T02:49:22.203ZINFOSledAgent (ServiceManager): Booting oxz_crucible_75db992d-930a-40c5-8e96-16838343192b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
14032024-12-21T02:49:22.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 60.255119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
14042024-12-21T02:49:22.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 103.946831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
14052024-12-21T02:49:22.501ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14062024-12-21T02:49:22.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 60.688214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
14072024-12-21T02:49:22.551ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
14082024-12-21T02:49:22.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 1.416180657s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
14092024-12-21T02:49:22.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 208.71407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
14102024-12-21T02:49:22.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 1.153485383s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
14112024-12-21T02:49:22.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 70.696196ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
14122024-12-21T02:49:22.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 981.996702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
14132024-12-21T02:49:22.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 870.999783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
14142024-12-21T02:49:22.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 232.091892ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
14152024-12-21T02:49:22.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 55.593868ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
14162024-12-21T02:49:22.788ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c441d2b7-b2d9-4b34-b899-42c3fd3b0719'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14172024-12-21T02:49:22.788ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
14182024-12-21T02:49:22.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 225.556438ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
14192024-12-21T02:49:22.811ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_80c94f92-4b7a-4dba-9905-839fe80ef014/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7448c580-fe51-4a8d-8b17-46e98b5bb8a6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14202024-12-21T02:49:22.811ZINFOSledAgent (ServiceManager): Booting oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
14212024-12-21T02:49:22.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 87.574762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
14222024-12-21T02:49:22.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 841.443172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
14232024-12-21T02:49:22.892ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='f33b7779-c528-4a50-88d2-df64a1c51a4f'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14242024-12-21T02:49:22.894ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
14252024-12-21T02:49:22.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 1.455587183s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
14262024-12-21T02:49:22.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 157.03764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
14272024-12-21T02:49:22.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 239.195006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
14282024-12-21T02:49:23.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 1.359490133s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
14292024-12-21T02:49:23.049ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14302024-12-21T02:49:23.050ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14312024-12-21T02:49:23.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 637.058611ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
14322024-12-21T02:49:23.066ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
14332024-12-21T02:49:23.075ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
14342024-12-21T02:49:23.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 66.377331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
14352024-12-21T02:49:23.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 65.821558ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
14362024-12-21T02:49:23.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 397.573005ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
14372024-12-21T02:49:23.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 74.812966ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
14382024-12-21T02:49:23.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 127.886808ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
14392024-12-21T02:49:23.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 86.095289ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
14402024-12-21T02:49:23.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 600.281189ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
14412024-12-21T02:49:23.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 84.138506ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
14422024-12-21T02:49:23.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 124.171765ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
14432024-12-21T02:49:23.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 42.326796ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
14442024-12-21T02:49:23.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 227.319195ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
14452024-12-21T02:49:23.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 280.820522ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
14462024-12-21T02:49:23.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 101.059014ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
14472024-12-21T02:49:23.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 491.168499ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
14482024-12-21T02:49:23.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 151.571004ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
14492024-12-21T02:49:23.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 1.157539548s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
14502024-12-21T02:49:23.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 523.125517ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
14512024-12-21T02:49:23.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 799.731228ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
14522024-12-21T02:49:23.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 572.53686ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
14532024-12-21T02:49:23.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 1.444456059s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
14542024-12-21T02:49:23.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 426.448604ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
14552024-12-21T02:49:23.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 658.343305ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
14562024-12-21T02:49:23.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 1.085568618s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
14572024-12-21T02:49:23.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 1.364309291s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
14582024-12-21T02:49:24.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 803.560074ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
14592024-12-21T02:49:24.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 428.159006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
14602024-12-21T02:49:24.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 832.231417ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
14612024-12-21T02:49:24.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 1.036289504s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
14622024-12-21T02:49:24.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 1.391567173s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
14632024-12-21T02:49:24.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 502.798821ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
14642024-12-21T02:49:24.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 1.047080147s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
14652024-12-21T02:49:24.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 539.871449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
14662024-12-21T02:49:24.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 872.938706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
14672024-12-21T02:49:24.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 1.489191821s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
14682024-12-21T02:49:24.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 1.212869613s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
14692024-12-21T02:49:24.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 1.489049214s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
14702024-12-21T02:49:24.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 1.08186202s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
14712024-12-21T02:49:24.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 1.027324932s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
14722024-12-21T02:49:24.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 659.441181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
14732024-12-21T02:49:24.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 1.480486574s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
14742024-12-21T02:49:25.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 804.307023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
14752024-12-21T02:49:25.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 1.344571349s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
14762024-12-21T02:49:25.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 641.542786ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
14772024-12-21T02:49:25.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 910.930831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
14782024-12-21T02:49:25.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 921.454481ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
14792024-12-21T02:49:25.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 1.112395833s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
14802024-12-21T02:49:25.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 879.48594ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
14812024-12-21T02:49:25.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 1.327298602s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
14822024-12-21T02:49:25.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 1.132544239s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
14832024-12-21T02:49:25.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 1.114080822s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
14842024-12-21T02:49:25.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 1.053531434s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
14852024-12-21T02:49:25.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 663.424508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
14862024-12-21T02:49:25.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 698.95624ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
14872024-12-21T02:49:25.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 1.358148398s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
14882024-12-21T02:49:26.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 902.103617ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
14892024-12-21T02:49:26.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 501.422848ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
14902024-12-21T02:49:26.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 1.216148072s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
14912024-12-21T02:49:26.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 1.331012957s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
14922024-12-21T02:49:26.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 1.279512141s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
14932024-12-21T02:49:26.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 1.13830744s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
14942024-12-21T02:49:26.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 790.695033ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
14952024-12-21T02:49:26.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 727.014528ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
14962024-12-21T02:49:26.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 1.399680398s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
14972024-12-21T02:49:26.659ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14982024-12-21T02:49:26.660ZINFOSledAgent (ServiceManager): Booting oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
14992024-12-21T02:49:26.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 50.155889ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
15002024-12-21T02:49:26.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 731.332827ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
15012024-12-21T02:49:26.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 69.218853ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
15022024-12-21T02:49:27.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 808.555966ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
15032024-12-21T02:49:27.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 665.522751ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
15042024-12-21T02:49:27.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 1.13645676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
15052024-12-21T02:49:27.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 1.408520503s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
15062024-12-21T02:49:27.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 134.26574ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
15072024-12-21T02:49:27.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 503.129677ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
15082024-12-21T02:49:27.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 685.294075ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
15092024-12-21T02:49:27.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 1.471165827s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
15102024-12-21T02:49:27.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 1.023061221s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
15112024-12-21T02:49:27.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 1.063201072s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
15122024-12-21T02:49:27.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 902.372213ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
15132024-12-21T02:49:27.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 878.893965ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
15142024-12-21T02:49:27.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 511.204038ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
15152024-12-21T02:49:27.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 636.783673ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
15162024-12-21T02:49:27.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 1.350483872s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
15172024-12-21T02:49:27.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 1.158272971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
15182024-12-21T02:49:27.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 915.188262ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
15192024-12-21T02:49:27.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 830.667974ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
15202024-12-21T02:49:27.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 1.439429945s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
15212024-12-21T02:49:28.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 937.670328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
15222024-12-21T02:49:28.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 1.49788033s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
15232024-12-21T02:49:28.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 1.302947146s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
15242024-12-21T02:49:28.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 754.690764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
15252024-12-21T02:49:28.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 873.493622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
15262024-12-21T02:49:28.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 1.179226318s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
15272024-12-21T02:49:28.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 732.786384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
15282024-12-21T02:49:28.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 1.119853697s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
15292024-12-21T02:49:28.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 1.201398563s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
15302024-12-21T02:49:28.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 638.700562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
15312024-12-21T02:49:28.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 692.428158ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
15322024-12-21T02:49:28.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 861.049485ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
15332024-12-21T02:49:28.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 1.129873689s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
15342024-12-21T02:49:29.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 575.575642ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
15352024-12-21T02:49:29.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 525.795673ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
15362024-12-21T02:49:29.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 1.016030145s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
15372024-12-21T02:49:29.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 714.557651ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
15382024-12-21T02:49:29.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 1.25066172s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
15392024-12-21T02:49:29.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 718.674931ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
15402024-12-21T02:49:29.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 1.335750378s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
15412024-12-21T02:49:29.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 732.143683ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
15422024-12-21T02:49:29.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 821.788999ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
15432024-12-21T02:49:29.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 723.518862ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
15442024-12-21T02:49:29.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 785.700641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
15452024-12-21T02:49:29.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 1.091080195s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
15462024-12-21T02:49:29.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 947.172029ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
15472024-12-21T02:49:29.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 631.893648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
15482024-12-21T02:49:29.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 980.146971ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
15492024-12-21T02:49:29.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 934.491385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
15502024-12-21T02:49:29.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 555.378577ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
15512024-12-21T02:49:30.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 859.065109ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
15522024-12-21T02:49:30.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 984.437939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
15532024-12-21T02:49:30.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 1.212633292s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
15542024-12-21T02:49:30.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 862.522912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
15552024-12-21T02:49:30.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 74.614383ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
15562024-12-21T02:49:30.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 517.957807ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
15572024-12-21T02:49:30.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 557.701308ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
15582024-12-21T02:49:30.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 140.558935ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
15592024-12-21T02:49:30.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 988.231941ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
15602024-12-21T02:49:30.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 1.43724258s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
15612024-12-21T02:49:30.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 206.686742ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
15622024-12-21T02:49:30.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 633.093935ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
15632024-12-21T02:49:30.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 676.124182ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
15642024-12-21T02:49:30.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 1.409843449s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
15652024-12-21T02:49:30.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 1.239958106s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
15662024-12-21T02:49:30.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 514.218107ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
15672024-12-21T02:49:30.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 760.328512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
15682024-12-21T02:49:30.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 1.160939458s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
15692024-12-21T02:49:30.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 768.657562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
15702024-12-21T02:49:30.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 643.946068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
15712024-12-21T02:49:30.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 938.676716ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
15722024-12-21T02:49:31.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 797.442957ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
15732024-12-21T02:49:31.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 601.507445ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
15742024-12-21T02:49:31.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 986.016396ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
15752024-12-21T02:49:31.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 630.060745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
15762024-12-21T02:49:31.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 1.046371876s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
15772024-12-21T02:49:31.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 418.598517ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
15782024-12-21T02:49:31.263ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15792024-12-21T02:49:31.263ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15802024-12-21T02:49:31.263ZINFOSledAgent (ServiceManager): Booting oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
15812024-12-21T02:49:31.269ZINFOSledAgent (ServiceManager): Booting oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5
15822024-12-21T02:49:31.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 1.498137723s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
15832024-12-21T02:49:31.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 1.143544551s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
15842024-12-21T02:49:31.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5") failed: Property not found. retry in 57.758293ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5
15852024-12-21T02:49:31.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 1.431120952s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
15862024-12-21T02:49:31.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 1.152156694s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
15872024-12-21T02:49:31.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33") failed: Property not found. retry in 56.098646ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
15882024-12-21T02:49:31.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5") failed: Property not found. retry in 79.78581ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5
15892024-12-21T02:49:31.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 1.408007433s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
15902024-12-21T02:49:31.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33") failed: Property not found. retry in 102.359695ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
15912024-12-21T02:49:31.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5") failed: Property not found. retry in 187.129372ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5
15922024-12-21T02:49:31.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 1.448339517s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
15932024-12-21T02:49:31.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 642.339898ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
15942024-12-21T02:49:31.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33") failed: Property not found. retry in 173.807864ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
15952024-12-21T02:49:31.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 1.263196433s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
15962024-12-21T02:49:31.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 626.120373ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
15972024-12-21T02:49:31.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5") failed: Property not found. retry in 488.416376ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5
15982024-12-21T02:49:31.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 1.407591179s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
15992024-12-21T02:49:31.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 858.513262ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
16002024-12-21T02:49:31.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33") failed: Property not found. retry in 543.436893ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
16012024-12-21T02:49:31.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 1.382443126s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
16022024-12-21T02:49:31.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 522.2025ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
16032024-12-21T02:49:32.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 1.159302393s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
16042024-12-21T02:49:32.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 758.927295ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
16052024-12-21T02:49:32.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 743.783281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
16062024-12-21T02:49:32.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5") failed: Property not found. retry in 974.352193ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5
16072024-12-21T02:49:32.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 1.246554265s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
16082024-12-21T02:49:32.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33") failed: Property not found. retry in 689.8777ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
16092024-12-21T02:49:32.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 708.79357ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
16102024-12-21T02:49:32.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 956.542743ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
16112024-12-21T02:49:32.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 966.94288ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
16122024-12-21T02:49:32.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 1.426978702s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
16132024-12-21T02:49:32.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 1.250108838s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
16142024-12-21T02:49:32.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 847.2354ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
16152024-12-21T02:49:32.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 819.344487ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
16162024-12-21T02:49:32.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 710.008353ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
16172024-12-21T02:49:32.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 882.776877ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
16182024-12-21T02:49:33.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 522.178481ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
16192024-12-21T02:49:33.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 734.14032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
16202024-12-21T02:49:33.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 557.652561ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
16212024-12-21T02:49:33.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33") failed: Property not found. retry in 1.119556908s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
16222024-12-21T02:49:33.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 829.523372ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
16232024-12-21T02:49:33.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 1.197700232s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
16242024-12-21T02:49:33.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 918.386939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
16252024-12-21T02:49:33.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5") failed: Property not found. retry in 1.321046884s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5
16262024-12-21T02:49:33.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 954.436916ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
16272024-12-21T02:49:33.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 936.092611ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
16282024-12-21T02:49:33.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 1.242755555s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
16292024-12-21T02:49:33.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 1.323999595s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
16302024-12-21T02:49:33.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 804.200842ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
16312024-12-21T02:49:33.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 904.03724ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
16322024-12-21T02:49:33.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 1.063201968s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
16332024-12-21T02:49:33.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 702.98309ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
16342024-12-21T02:49:33.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 1.176985876s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
16352024-12-21T02:49:33.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 1.055424923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
16362024-12-21T02:49:33.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 1.141639623s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
16372024-12-21T02:49:34.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 574.560505ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
16382024-12-21T02:49:34.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 920.831185ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
16392024-12-21T02:49:34.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 885.730939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
16402024-12-21T02:49:34.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 1.348235723s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
16412024-12-21T02:49:34.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33") failed: Property not found. retry in 572.322163ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
16422024-12-21T02:49:34.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 957.241804ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
16432024-12-21T02:49:34.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 1.189104698s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
16442024-12-21T02:49:34.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 1.131279578s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
16452024-12-21T02:49:34.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 1.123871255s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
16462024-12-21T02:49:34.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 1.363109197s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
16472024-12-21T02:49:34.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 938.094195ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
16482024-12-21T02:49:34.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 989.688058ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
16492024-12-21T02:49:34.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5") failed: Property not found. retry in 646.212973ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5
16502024-12-21T02:49:34.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 576.648486ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
16512024-12-21T02:49:34.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 993.281372ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
16522024-12-21T02:49:34.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33") failed: Property not found. retry in 602.840007ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
16532024-12-21T02:49:34.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 1.230100152s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
16542024-12-21T02:49:34.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 1.451396688s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
16552024-12-21T02:49:34.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 1.295586286s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
16562024-12-21T02:49:34.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 1.387116544s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
16572024-12-21T02:49:35.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 528.240924ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
16582024-12-21T02:49:35.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 1.441212989s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
16592024-12-21T02:49:35.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 734.271225ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
16602024-12-21T02:49:35.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5") failed: Property not found. retry in 1.465954202s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5
16612024-12-21T02:49:35.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 1.184496176s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
16622024-12-21T02:49:35.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33") failed: Property not found. retry in 610.201607ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
16632024-12-21T02:49:35.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 954.374794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
16642024-12-21T02:49:35.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 1.189581361s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
16652024-12-21T02:49:35.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 989.861601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
16662024-12-21T02:49:35.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 1.484070459s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
16672024-12-21T02:49:35.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 982.84321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
16682024-12-21T02:49:35.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 572.672515ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
16692024-12-21T02:49:35.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 922.835606ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
16702024-12-21T02:49:35.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 742.05433ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
16712024-12-21T02:49:35.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 1.093408126s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
16722024-12-21T02:49:36.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 667.93757ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
16732024-12-21T02:49:36.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33") failed: Property not found. retry in 1.385296102s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
16742024-12-21T02:49:36.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 1.147469226s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
16752024-12-21T02:49:36.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 869.18353ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
16762024-12-21T02:49:36.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 609.711288ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
16772024-12-21T02:49:36.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 801.699251ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
16782024-12-21T02:49:36.372ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16792024-12-21T02:49:36.372ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738
16802024-12-21T02:49:36.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 1.432823371s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
16812024-12-21T02:49:36.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 852.561627ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
16822024-12-21T02:49:36.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 1.361986862s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
16832024-12-21T02:49:36.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 1.338285248s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
16842024-12-21T02:49:36.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 1.143467564s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
16852024-12-21T02:49:36.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 1.199329898s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
16862024-12-21T02:49:36.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 977.7446ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
16872024-12-21T02:49:36.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738") failed: Property not found. retry in 71.837369ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738
16882024-12-21T02:49:36.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 1.047986178s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
16892024-12-21T02:49:36.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 844.795082ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
16902024-12-21T02:49:36.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738") failed: Property not found. retry in 70.720768ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738
16912024-12-21T02:49:36.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 1.206103872s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
16922024-12-21T02:49:36.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5") failed: Property not found. retry in 1.359298765s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5
16932024-12-21T02:49:36.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738") failed: Property not found. retry in 122.839591ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738
16942024-12-21T02:49:36.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 1.437829994s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
16952024-12-21T02:49:36.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 801.441367ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
16962024-12-21T02:49:37.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738") failed: Property not found. retry in 308.480638ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738
16972024-12-21T02:49:37.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 581.376408ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
16982024-12-21T02:49:37.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 584.693223ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
16992024-12-21T02:49:37.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 1.123440208s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
17002024-12-21T02:49:37.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 965.49046ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
17012024-12-21T02:49:37.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738") failed: Property not found. retry in 745.71834ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738
17022024-12-21T02:49:37.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 514.434209ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
17032024-12-21T02:49:37.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33") failed: Property not found. retry in 925.687111ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
17042024-12-21T02:49:37.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 748.646191ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
17052024-12-21T02:49:37.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 944.472117ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
17062024-12-21T02:49:37.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 613.416928ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
17072024-12-21T02:49:37.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 936.819523ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
17082024-12-21T02:49:37.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 1.055100159s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
17092024-12-21T02:49:37.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 1.221549194s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
17102024-12-21T02:49:37.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 839.577201ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
17112024-12-21T02:49:37.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 1.128658216s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
17122024-12-21T02:49:37.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 1.359940302s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
17132024-12-21T02:49:37.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 1.329609549s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
17142024-12-21T02:49:37.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 1.003413225s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
17152024-12-21T02:49:37.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 1.43679109s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
17162024-12-21T02:49:38.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 891.762922ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
17172024-12-21T02:49:38.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738") failed: Property not found. retry in 1.468201528s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738
17182024-12-21T02:49:38.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5") failed: Property not found. retry in 623.205439ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5
17192024-12-21T02:49:38.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 682.255482ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
17202024-12-21T02:49:38.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 1.158063832s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
17212024-12-21T02:49:38.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 778.081137ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
17222024-12-21T02:49:38.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 720.675527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
17232024-12-21T02:49:38.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 1.385162923s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
17242024-12-21T02:49:38.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33") failed: Property not found. retry in 699.53122ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
17252024-12-21T02:49:38.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 544.450817ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
17262024-12-21T02:49:38.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 1.34653739s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
17272024-12-21T02:49:38.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 542.244187ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
17282024-12-21T02:49:38.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 960.533968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
17292024-12-21T02:49:38.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5") failed: Property not found. retry in 1.279216627s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5
17302024-12-21T02:49:38.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 593.059131ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
17312024-12-21T02:49:38.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 1.410921678s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
17322024-12-21T02:49:38.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 1.256487942s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
17332024-12-21T02:49:38.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 651.069575ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
17342024-12-21T02:49:39.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 890.345516ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
17352024-12-21T02:49:39.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b") failed: Property not found. retry in 1.224324672s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
17362024-12-21T02:49:39.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 1.361783531s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
17372024-12-21T02:49:39.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 510.04352ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
17382024-12-21T02:49:39.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33") failed: Property not found. retry in 954.272822ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
17392024-12-21T02:49:39.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 869.378704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
17402024-12-21T02:49:39.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 1.188350973s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
17412024-12-21T02:49:39.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 773.737632ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
17422024-12-21T02:49:39.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416") failed: Property not found. retry in 1.237992437s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
17432024-12-21T02:49:39.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 1.29685586s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
17442024-12-21T02:49:39.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 1.451972649s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
17452024-12-21T02:49:39.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738") failed: Property not found. retry in 1.424092656s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738
17462024-12-21T02:49:39.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 717.44217ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
17472024-12-21T02:49:39.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 506.268424ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
17482024-12-21T02:49:39.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 1.155327847s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
17492024-12-21T02:49:39.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110") failed: Property not found. retry in 871.344556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
17502024-12-21T02:49:39.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 1.493516818s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
17512024-12-21T02:49:39.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e") failed: Property not found. retry in 710.312583ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
17522024-12-21T02:49:40.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0") failed: Property not found. retry in 1.368610208s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
17532024-12-21T02:49:40.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727") failed: Property not found. retry in 870.405958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
17542024-12-21T02:49:40.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33") failed: Property not found. retry in 583.477059ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
17552024-12-21T02:49:40.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5") failed: Property not found. retry in 1.477986767s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5
17562024-12-21T02:49:40.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c") failed: Property not found. retry in 550.679268ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
17572024-12-21T02:49:40.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 1.074758353s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
17582024-12-21T02:49:40.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 567.71342ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
17592024-12-21T02:49:40.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 767.937062ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
17602024-12-21T02:49:40.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 1.288847206s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
17612024-12-21T02:49:40.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 957.427496ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
17622024-12-21T02:49:40.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33") failed: Property not found. retry in 917.122035ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
17632024-12-21T02:49:40.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd") failed: Property not found. retry in 968.262341ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
17642024-12-21T02:49:40.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 1.39821495s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
17652024-12-21T02:49:40.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 701.233502ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
17662024-12-21T02:49:41.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec") failed: Property not found. retry in 1.386253622s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
17672024-12-21T02:49:41.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738") failed: Property not found. retry in 1.498567898s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738
17682024-12-21T02:49:41.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 1.001807323s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
17692024-12-21T02:49:41.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 617.470971ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
17702024-12-21T02:49:41.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 580.46207ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
17712024-12-21T02:49:41.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f") failed: Property not found. retry in 1.086320907s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
17722024-12-21T02:49:41.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 502.933097ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
17732024-12-21T02:49:41.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d") failed: Property not found. retry in 1.229631065s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
17742024-12-21T02:49:41.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9") failed: Property not found. retry in 1.13428257s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
17752024-12-21T02:49:42.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 558.872318ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
17762024-12-21T02:49:42.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_75db992d-930a-40c5-8e96-16838343192b") failed: Property not found. retry in 800.41076ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
17772024-12-21T02:49:42.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f") failed: Property not found. retry in 1.477740568s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
17782024-12-21T02:49:42.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8") failed: Property not found. retry in 841.971271ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
17792024-12-21T02:49:42.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738") failed: Property not found. retry in 896.907665ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738
17802024-12-21T02:49:42.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3") failed: Property not found. retry in 1.301481745s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
17812024-12-21T02:49:43.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738") failed: Property not found. retry in 1.383417557s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738
17822024-12-21T02:49:44.246ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 35.456621666s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
17832024-12-21T02:49:44.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738") failed: Property not found. retry in 708.493181ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738
17842024-12-21T02:49:45.082ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) file = sled-agent/src/probe_manager.rs:231 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
17852024-12-21T02:49:45.083ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) file = sled-agent/src/nexus.rs:527 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
17862024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_a26cf9be-8b60-4ac4-a6be-4413c28cf3ec
17872024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_75db992d-930a-40c5-8e96-16838343192b
17882024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_82a0d97c-0396-4dff-a562-7bc3f12f4b4d
17892024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_7d789b63-e234-471f-abd5-426e10c5c6e3
17902024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_228b24aa-49c3-498e-abc2-ed3654961d5f
17912024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_0a9a83a1-8dc9-4e39-82af-02dacafaf0cd
17922024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_5f52ac53-51c8-4771-9e69-2b7ae5f68b33
17932024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_e1c39328-dcf4-4014-b8e4-04d473419416
17942024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_4f50fa81-5371-4a88-a8b4-4e3726e451a5
17952024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_dcf56aa4-8d02-4872-82c4-3d769bb7bde8
17962024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_oximeter_f33b7779-c528-4a50-88d2-df64a1c51a4f
17972024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_8404d553-7432-487e-b86a-f2936cc38dc9
17982024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_5582a5e8-4d18-43d7-91c6-2d1f93c50727
17992024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_5e04e3e8-5475-45b9-8405-9d7a27d9943c
18002024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_a67fcd8e-814b-49e1-b8bd-3e5612ba395e
18012024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_d7a4c825-8ff7-4c05-b91b-be54fad325d0
18022024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_596122c8-db10-4efe-8fc6-817547aa5c5b
18032024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_clickhouse_0b390f7f-a043-488f-816f-887c9fdc5738
18042024-12-21T02:49:45.635ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_66ae7088-b8a7-490b-a117-c5fd46b35110
18052024-12-21T02:49:45.636ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18062024-12-21T02:49:45.638ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18072024-12-21T02:49:45.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29266686 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34470 req_id = 284fd763-f525-41b4-bb72-2a48f37b62b4 response_code = 204 uri = /omicron-zones
18082024-12-21T02:49:45.645ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
18092024-12-21T02:49:45.649ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
18102024-12-21T02:49:45.651ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:802
18112024-12-21T02:49:45.684ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
18122024-12-21T02:49:45.685ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/e82f3ce5-f4b3-438e-a750-485ef194a2d5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18132024-12-21T02:49:45.782ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/e82f3ce5-f4b3-438e-a750-485ef194a2d5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18142024-12-21T02:49:45.848ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/e82f3ce5-f4b3-438e-a750-485ef194a2d5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18152024-12-21T02:49:45.943ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/e82f3ce5-f4b3-438e-a750-485ef194a2d5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18162024-12-21T02:49:46.090ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) file = sled-agent/src/probe_manager.rs:231 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
18172024-12-21T02:49:46.172ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/e82f3ce5-f4b3-438e-a750-485ef194a2d5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18182024-12-21T02:49:46.333ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) file = sled-agent/src/nexus.rs:527 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
18192024-12-21T02:49:46.424ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/e82f3ce5-f4b3-438e-a750-485ef194a2d5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18202024-12-21T02:49:46.748ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/e82f3ce5-f4b3-438e-a750-485ef194a2d5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18212024-12-21T02:49:47.095ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/74b11855-33fc-4fcf-8c0e-d7e8e9d5e531) file = sled-agent/src/probe_manager.rs:231 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
18222024-12-21T02:49:47.117ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/e82f3ce5-f4b3-438e-a750-485ef194a2d5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18232024-12-21T02:49:47.505ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/e82f3ce5-f4b3-438e-a750-485ef194a2d5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18242024-12-21T02:49:48.091ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/e82f3ce5-f4b3-438e-a750-485ef194a2d5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18252024-12-21T02:49:48.899ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ac4fb13f-0d65-469f-94c0-fe8a59ba1055", "content-length": "173", "date": "Sat, 21 Dec 2024 02:49:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"e82f3ce5-f4b3-438e-a750-485ef194a2d5\"", request_id: "ac4fb13f-0d65-469f-94c0-fe8a59ba1055" } file = sled-agent/src/rack_setup/service.rs:1078
18262024-12-21T02:49:49.289ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57511
18272024-12-21T02:49:49.289ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57511 req_id = d92cc131-f184-470e-b421-16b45305d0c3 response_code = 200 uri = /baseboard
18282024-12-21T02:49:49.921ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8c1cfa7d-0a5a-4c69-a948-62d72bc15d10", "content-length": "173", "date": "Sat, 21 Dec 2024 02:49:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"e82f3ce5-f4b3-438e-a750-485ef194a2d5\"", request_id: "8c1cfa7d-0a5a-4c69-a948-62d72bc15d10" } file = sled-agent/src/rack_setup/service.rs:1078
18292024-12-21T02:49:50.584ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
18302024-12-21T02:49:50.851ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "745b4779-3847-4140-b80b-2a4efba0bb57", "content-length": "173", "date": "Sat, 21 Dec 2024 02:49:50 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"e82f3ce5-f4b3-438e-a750-485ef194a2d5\"", request_id: "745b4779-3847-4140-b80b-2a4efba0bb57" } file = sled-agent/src/rack_setup/service.rs:1078
18312024-12-21T02:49:51.474ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "daf5c13b-f298-404c-babd-afe6b405609b", "content-length": "173", "date": "Sat, 21 Dec 2024 02:49:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"e82f3ce5-f4b3-438e-a750-485ef194a2d5\"", request_id: "daf5c13b-f298-404c-babd-afe6b405609b" } file = sled-agent/src/rack_setup/service.rs:1078
18322024-12-21T02:49:52.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43904
18332024-12-21T02:49:52.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1595 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43904 req_id = 167b9d06-315b-4df4-ba35-040e3344687b response_code = 200 uri = /vpc-routes
18342024-12-21T02:49:52.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60669
18352024-12-21T02:49:52.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60669 req_id = 166d0c6b-167a-443a-8096-a66b7326f06a response_code = 200 uri = /vpc-routes
18362024-12-21T02:49:52.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64938
18372024-12-21T02:49:52.665ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18382024-12-21T02:49:52.665ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18392024-12-21T02:49:52.665ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/omicron-zones.json file = common/src/ledger.rs:177
18402024-12-21T02:49:52.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64441
18412024-12-21T02:49:52.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38107
18422024-12-21T02:49:52.665ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/omicron-zones.json file = common/src/ledger.rs:177
18432024-12-21T02:49:52.665ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18442024-12-21T02:49:52.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38107 req_id = efe39f76-9f0d-4e5f-b7d5-973bd0055092 response_code = 200 uri = /vpc-routes
18452024-12-21T02:49:52.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62941
18462024-12-21T02:49:52.678ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18472024-12-21T02:49:52.678ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_80c94f92-4b7a-4dba-9905-839fe80ef014
18482024-12-21T02:49:52.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3744 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62941 req_id = 7b352ebb-c192-4cbb-824a-4e67923340b0 response_code = 200 uri = /v2p
18492024-12-21T02:49:52.695ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18502024-12-21T02:49:52.695ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/omicron-zones.json file = common/src/ledger.rs:177
18512024-12-21T02:49:52.699ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/omicron-zones.json file = common/src/ledger.rs:177
18522024-12-21T02:49:52.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36038
18532024-12-21T02:49:52.706ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18542024-12-21T02:49:52.706ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18552024-12-21T02:49:52.706ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/omicron-zones.json file = common/src/ledger.rs:177
18562024-12-21T02:49:52.706ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/omicron-zones.json file = common/src/ledger.rs:177
18572024-12-21T02:49:52.706ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18582024-12-21T02:49:52.706ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9
18592024-12-21T02:49:52.728ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18602024-12-21T02:49:52.728ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_80c94f92-4b7a-4dba-9905-839fe80ef014
18612024-12-21T02:49:52.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50465
18622024-12-21T02:49:52.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50465 req_id = 74fa72ec-fdb2-4a34-b30d-29f5a45e3ae0 response_code = 200 uri = /v2p
18632024-12-21T02:49:52.746ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18642024-12-21T02:49:52.746ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_80c94f92-4b7a-4dba-9905-839fe80ef014
18652024-12-21T02:49:52.768ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18662024-12-21T02:49:52.768ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0
18672024-12-21T02:49:52.776ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
18682024-12-21T02:49:52.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 735 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43904 req_id = 303a0c6a-d9dd-4293-9e15-524527dbeaf1 response_code = 204 uri = /eip-gateways
18692024-12-21T02:49:52.790ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18702024-12-21T02:49:52.790ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9
18712024-12-21T02:49:52.810ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18722024-12-21T02:49:52.810ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9
18732024-12-21T02:49:52.834ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18742024-12-21T02:49:52.834ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0
18752024-12-21T02:49:52.850ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18762024-12-21T02:49:52.850ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a1307d86-524f-4687-99b5-553fb50f6ebe
18772024-12-21T02:49:52.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36080
18782024-12-21T02:49:52.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36080 req_id = d22bfb38-78a0-425b-99f6-c3a9597762b8 response_code = 200 uri = /v2p
18792024-12-21T02:49:52.868ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18802024-12-21T02:49:52.868ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0
18812024-12-21T02:49:52.876ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
18822024-12-21T02:49:52.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60669 req_id = 25636151-d491-41ad-91e2-ed16feebb83e response_code = 204 uri = /eip-gateways
18832024-12-21T02:49:52.877ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
18842024-12-21T02:49:52.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38107 req_id = 93cdd7f5-8c18-4dba-a234-6a0d475a1de4 response_code = 204 uri = /eip-gateways
18852024-12-21T02:49:52.886ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18862024-12-21T02:49:52.886ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a1307d86-524f-4687-99b5-553fb50f6ebe
18872024-12-21T02:49:52.904ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18882024-12-21T02:49:52.904ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12
18892024-12-21T02:49:52.922ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18902024-12-21T02:49:52.922ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a1307d86-524f-4687-99b5-553fb50f6ebe
18912024-12-21T02:49:52.939ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18922024-12-21T02:49:52.939ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12
18932024-12-21T02:49:52.961ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18942024-12-21T02:49:52.961ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_98af376c-57d5-4d4e-8868-ff737627f482
18952024-12-21T02:49:53.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43904 req_id = e56ca002-0bb2-49be-a432-f990af1ae949 response_code = 204 uri = /vpc-routes
18962024-12-21T02:49:53.008ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } subnet = RouterId { vni: Vni(100), kind: System }
18972024-12-21T02:49:53.008ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18982024-12-21T02:49:53.008ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12
18992024-12-21T02:49:53.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38107 req_id = 8ebb81b9-fbca-4d0a-ae23-899ab0999cee response_code = 204 uri = /vpc-routes
19002024-12-21T02:49:53.013ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } subnet = RouterId { vni: Vni(100), kind: System }
19012024-12-21T02:49:53.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60669 req_id = 6db1ec7b-0a52-428c-bf64-80d4afcc1d33 response_code = 204 uri = /vpc-routes
19022024-12-21T02:49:53.025ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19032024-12-21T02:49:53.025ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_98af376c-57d5-4d4e-8868-ff737627f482
19042024-12-21T02:49:53.037ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19052024-12-21T02:49:53.037ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_63c9df44-0622-415c-a697-efc3e7bc6c27
19062024-12-21T02:49:53.051ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19072024-12-21T02:49:53.051ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_98af376c-57d5-4d4e-8868-ff737627f482
19082024-12-21T02:49:53.066ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19092024-12-21T02:49:53.066ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_63c9df44-0622-415c-a697-efc3e7bc6c27
19102024-12-21T02:49:53.081ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19112024-12-21T02:49:53.081ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81a0e2aa-7a9f-464b-aaff-78e01f8fe036
19122024-12-21T02:49:53.095ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19132024-12-21T02:49:53.096ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_63c9df44-0622-415c-a697-efc3e7bc6c27
19142024-12-21T02:49:53.110ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19152024-12-21T02:49:53.110ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc
19162024-12-21T02:49:53.122ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19172024-12-21T02:49:53.122ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81a0e2aa-7a9f-464b-aaff-78e01f8fe036
19182024-12-21T02:49:53.135ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19192024-12-21T02:49:53.137ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81a0e2aa-7a9f-464b-aaff-78e01f8fe036
19202024-12-21T02:49:53.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 511319 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64938 req_id = 09c7a97e-94fa-4f81-b2a6-2ab2fc49aaec response_code = 200 uri = /inventory
19212024-12-21T02:49:53.151ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19222024-12-21T02:49:53.151ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc
19232024-12-21T02:49:53.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 502795 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64441 req_id = 0c101567-ba32-49f3-bec9-bc368a0147ff response_code = 200 uri = /inventory
19242024-12-21T02:49:53.174ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19252024-12-21T02:49:53.174ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc
19262024-12-21T02:49:53.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 486667 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36038 req_id = 8c5fbb03-494f-413a-bb16-25e7f55b8a4d response_code = 200 uri = /inventory
19272024-12-21T02:49:53.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54878
19282024-12-21T02:49:53.701ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19292024-12-21T02:49:53.701ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19302024-12-21T02:49:53.701ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/omicron-zones.json file = common/src/ledger.rs:177
19312024-12-21T02:49:53.701ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/omicron-zones.json file = common/src/ledger.rs:177
19322024-12-21T02:49:53.713ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19332024-12-21T02:49:53.713ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_80c94f92-4b7a-4dba-9905-839fe80ef014
19342024-12-21T02:49:53.742ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19352024-12-21T02:49:53.742ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9
19362024-12-21T02:49:53.768ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19372024-12-21T02:49:53.768ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0
19382024-12-21T02:49:53.794ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19392024-12-21T02:49:53.794ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a1307d86-524f-4687-99b5-553fb50f6ebe
19402024-12-21T02:49:53.818ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19412024-12-21T02:49:53.818ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12
19422024-12-21T02:49:53.840ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19432024-12-21T02:49:53.840ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_98af376c-57d5-4d4e-8868-ff737627f482
19442024-12-21T02:49:53.862ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19452024-12-21T02:49:53.862ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_63c9df44-0622-415c-a697-efc3e7bc6c27
19462024-12-21T02:49:53.882ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19472024-12-21T02:49:53.882ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81a0e2aa-7a9f-464b-aaff-78e01f8fe036
19482024-12-21T02:49:53.901ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19492024-12-21T02:49:53.901ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc
19502024-12-21T02:49:53.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213816 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54878 req_id = 4e52ef67-3d66-43d2-850b-da64d6be292c response_code = 200 uri = /inventory
19512024-12-21T02:49:54.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54206
19522024-12-21T02:49:54.899ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e6764d0d-89f4-4d8a-aa9a-63a6b6c44f9c, kind: Service { id: 82a0d97c-0396-4dff-a562-7bc3f12f4b4d }, name: Name("external-dns-82a0d97c-0396-4dff-a562-7bc3f12f4b4d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 117])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b4479d-d7bc-48c5-b3c2-7051533d16f5, kind: Service { id: 7d789b63-e234-471f-abd5-426e10c5c6e3 }, name: Name("external-dns-7d789b63-e234-471f-abd5-426e10c5c6e3"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 89])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 86470b3f-1b5e-4e63-bb28-a8ff8c9cee13, kind: Service { id: 4f50fa81-5371-4a88-a8b4-4e3726e451a5 }, name: Name("nexus-4f50fa81-5371-4a88-a8b4-4e3726e451a5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9382bc6b-4023-4b07-839c-d3afc84529d0, kind: Service { id: 5f52ac53-51c8-4771-9e69-2b7ae5f68b33 }, name: Name("nexus-5f52ac53-51c8-4771-9e69-2b7ae5f68b33"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 240])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6053b1c-903b-4570-b781-38175f6759a7, kind: Service { id: dcf56aa4-8d02-4872-82c4-3d769bb7bde8 }, name: Name("nexus-dcf56aa4-8d02-4872-82c4-3d769bb7bde8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19532024-12-21T02:49:54.899ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19542024-12-21T02:49:54.899ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19552024-12-21T02:49:54.899ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19562024-12-21T02:49:54.899ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19572024-12-21T02:49:54.899ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19582024-12-21T02:49:54.899ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19592024-12-21T02:49:54.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1359 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54206 req_id = 1ef122a3-fd6c-45f5-a536-c4291adf687f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19602024-12-21T02:49:54.900ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
19612024-12-21T02:49:54.904ZINFOSledAgent (RSS): Writing ledger to /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
19622024-12-21T02:49:54.904ZINFOSledAgent (RSS): Writing ledger to /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
19632024-12-21T02:49:55.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35400
19642024-12-21T02:49:55.331ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19652024-12-21T02:49:55.331ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19662024-12-21T02:49:55.331ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/omicron-zones.json file = common/src/ledger.rs:177
19672024-12-21T02:49:55.337ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/omicron-zones.json file = common/src/ledger.rs:177
19682024-12-21T02:49:55.349ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19692024-12-21T02:49:55.349ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_80c94f92-4b7a-4dba-9905-839fe80ef014
19702024-12-21T02:49:55.375ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19712024-12-21T02:49:55.375ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9
19722024-12-21T02:49:55.396ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19732024-12-21T02:49:55.396ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0
19742024-12-21T02:49:55.416ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19752024-12-21T02:49:55.416ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a1307d86-524f-4687-99b5-553fb50f6ebe
19762024-12-21T02:49:55.436ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19772024-12-21T02:49:55.436ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12
19782024-12-21T02:49:55.456ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19792024-12-21T02:49:55.456ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_98af376c-57d5-4d4e-8868-ff737627f482
19802024-12-21T02:49:55.475ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19812024-12-21T02:49:55.475ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_63c9df44-0622-415c-a697-efc3e7bc6c27
19822024-12-21T02:49:55.497ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19832024-12-21T02:49:55.497ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81a0e2aa-7a9f-464b-aaff-78e01f8fe036
19842024-12-21T02:49:55.519ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19852024-12-21T02:49:55.519ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc
19862024-12-21T02:49:55.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199505 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35400 req_id = 86e1cefb-f730-4d95-bee6-10b15a3b598d response_code = 200 uri = /inventory
19872024-12-21T02:49:55.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41584
19882024-12-21T02:49:55.993ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e6764d0d-89f4-4d8a-aa9a-63a6b6c44f9c, kind: Service { id: 82a0d97c-0396-4dff-a562-7bc3f12f4b4d }, name: Name("external-dns-82a0d97c-0396-4dff-a562-7bc3f12f4b4d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 117])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b4479d-d7bc-48c5-b3c2-7051533d16f5, kind: Service { id: 7d789b63-e234-471f-abd5-426e10c5c6e3 }, name: Name("external-dns-7d789b63-e234-471f-abd5-426e10c5c6e3"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 89])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 86470b3f-1b5e-4e63-bb28-a8ff8c9cee13, kind: Service { id: 4f50fa81-5371-4a88-a8b4-4e3726e451a5 }, name: Name("nexus-4f50fa81-5371-4a88-a8b4-4e3726e451a5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9382bc6b-4023-4b07-839c-d3afc84529d0, kind: Service { id: 5f52ac53-51c8-4771-9e69-2b7ae5f68b33 }, name: Name("nexus-5f52ac53-51c8-4771-9e69-2b7ae5f68b33"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 240])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6053b1c-903b-4570-b781-38175f6759a7, kind: Service { id: dcf56aa4-8d02-4872-82c4-3d769bb7bde8 }, name: Name("nexus-dcf56aa4-8d02-4872-82c4-3d769bb7bde8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19892024-12-21T02:49:55.993ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19902024-12-21T02:49:55.993ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19912024-12-21T02:49:55.993ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19922024-12-21T02:49:55.993ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19932024-12-21T02:49:55.993ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19942024-12-21T02:49:55.993ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19952024-12-21T02:49:55.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41584 req_id = c1a14c57-6085-4878-a7fd-551666c5f6e8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19962024-12-21T02:49:56.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48429
19972024-12-21T02:49:56.439ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e6764d0d-89f4-4d8a-aa9a-63a6b6c44f9c, kind: Service { id: 82a0d97c-0396-4dff-a562-7bc3f12f4b4d }, name: Name("external-dns-82a0d97c-0396-4dff-a562-7bc3f12f4b4d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 117])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b4479d-d7bc-48c5-b3c2-7051533d16f5, kind: Service { id: 7d789b63-e234-471f-abd5-426e10c5c6e3 }, name: Name("external-dns-7d789b63-e234-471f-abd5-426e10c5c6e3"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 89])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 86470b3f-1b5e-4e63-bb28-a8ff8c9cee13, kind: Service { id: 4f50fa81-5371-4a88-a8b4-4e3726e451a5 }, name: Name("nexus-4f50fa81-5371-4a88-a8b4-4e3726e451a5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9382bc6b-4023-4b07-839c-d3afc84529d0, kind: Service { id: 5f52ac53-51c8-4771-9e69-2b7ae5f68b33 }, name: Name("nexus-5f52ac53-51c8-4771-9e69-2b7ae5f68b33"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 240])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6053b1c-903b-4570-b781-38175f6759a7, kind: Service { id: dcf56aa4-8d02-4872-82c4-3d769bb7bde8 }, name: Name("nexus-dcf56aa4-8d02-4872-82c4-3d769bb7bde8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19982024-12-21T02:49:56.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19992024-12-21T02:49:56.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20002024-12-21T02:49:56.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20012024-12-21T02:49:56.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20022024-12-21T02:49:56.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20032024-12-21T02:49:56.439ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20042024-12-21T02:49:56.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 358 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48429 req_id = f15f99b1-6788-4ee5-aea7-efe776a04fad response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20052024-12-21T02:49:56.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49066
20062024-12-21T02:49:56.458ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e6764d0d-89f4-4d8a-aa9a-63a6b6c44f9c, kind: Service { id: 82a0d97c-0396-4dff-a562-7bc3f12f4b4d }, name: Name("external-dns-82a0d97c-0396-4dff-a562-7bc3f12f4b4d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 117])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b4479d-d7bc-48c5-b3c2-7051533d16f5, kind: Service { id: 7d789b63-e234-471f-abd5-426e10c5c6e3 }, name: Name("external-dns-7d789b63-e234-471f-abd5-426e10c5c6e3"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 89])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 86470b3f-1b5e-4e63-bb28-a8ff8c9cee13, kind: Service { id: 4f50fa81-5371-4a88-a8b4-4e3726e451a5 }, name: Name("nexus-4f50fa81-5371-4a88-a8b4-4e3726e451a5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9382bc6b-4023-4b07-839c-d3afc84529d0, kind: Service { id: 5f52ac53-51c8-4771-9e69-2b7ae5f68b33 }, name: Name("nexus-5f52ac53-51c8-4771-9e69-2b7ae5f68b33"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 240])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6053b1c-903b-4570-b781-38175f6759a7, kind: Service { id: dcf56aa4-8d02-4872-82c4-3d769bb7bde8 }, name: Name("nexus-dcf56aa4-8d02-4872-82c4-3d769bb7bde8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20072024-12-21T02:49:56.458ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20082024-12-21T02:49:56.458ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20092024-12-21T02:49:56.458ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20102024-12-21T02:49:56.458ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20112024-12-21T02:49:56.458ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20122024-12-21T02:49:56.458ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20132024-12-21T02:49:56.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49066 req_id = 5b5d3c9e-4e3c-4123-9d4e-66795519eed1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20142024-12-21T02:50:01.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39142
20152024-12-21T02:50:01.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39142 req_id = 2cc83fbe-4a4d-40ed-9c0d-5f6393e2493f response_code = 200 uri = /vpc-routes
20162024-12-21T02:50:01.648ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
20172024-12-21T02:50:01.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39142 req_id = 8287f45d-2e41-41ab-9afc-7580f614ba04 response_code = 204 uri = /eip-gateways
20182024-12-21T02:50:01.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39142 req_id = 60c50926-a5ae-4b30-9407-9dca78cf392f response_code = 204 uri = /vpc-routes
20192024-12-21T02:50:19.324ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39823
20202024-12-21T02:50:19.324ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39823 req_id = 8267d34b-3b7b-4e58-a8ca-bc5ba64b3107 response_code = 200 uri = /baseboard
20212024-12-21T02:50:22.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46937
20222024-12-21T02:50:22.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46937 req_id = a9fb538d-4cf3-4f33-bbc8-3fc708e7adff response_code = 200 uri = /vpc-routes
20232024-12-21T02:50:22.109ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
20242024-12-21T02:50:22.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46937 req_id = 8ed42e7d-da66-4786-ba28-0bb9f8d6476a response_code = 204 uri = /eip-gateways
20252024-12-21T02:50:22.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37395
20262024-12-21T02:50:22.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37395 req_id = fd7d195e-dc6c-428d-8bbf-1d4cbdae6e00 response_code = 200 uri = /v2p
20272024-12-21T02:50:22.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44214
20282024-12-21T02:50:22.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44214 req_id = 5aa250f7-82c5-4e9a-9d56-8e04036f9ebb response_code = 200 uri = /vpc-routes
20292024-12-21T02:50:22.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62583
20302024-12-21T02:50:22.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62583 req_id = 3847b41f-152d-43a0-95a8-5ea18d594c7e response_code = 200 uri = /v2p
20312024-12-21T02:50:22.264ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
20322024-12-21T02:50:22.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44214 req_id = 8fa54345-fcc0-4d35-8491-a212d5bf7994 response_code = 204 uri = /eip-gateways
20332024-12-21T02:50:22.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46937 req_id = e1940df6-1fe0-4afd-9ae1-d74af916d266 response_code = 204 uri = /vpc-routes
20342024-12-21T02:50:22.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44214 req_id = 2d701f71-69a3-42b5-98f2-abc317a7d2de response_code = 204 uri = /vpc-routes
20352024-12-21T02:50:22.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51478
20362024-12-21T02:50:22.411ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20372024-12-21T02:50:22.500ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20382024-12-21T02:50:22.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182986 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51478 req_id = 4f57d887-3d3b-4038-8e79-5e281b129b12 response_code = 204 uri = /switch-ports
20392024-12-21T02:50:22.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46539
20402024-12-21T02:50:22.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39471
20412024-12-21T02:50:22.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 489 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51478 req_id = d658c775-bf59-4cb0-beed-c20cb1d13562 response_code = 200 uri = /network-bootstore-config
20422024-12-21T02:50:22.594ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20432024-12-21T02:50:22.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46539 req_id = 93866cb7-113e-4819-9f30-7b3313e8b06b response_code = 200 uri = /vpc-routes
20442024-12-21T02:50:22.631ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
20452024-12-21T02:50:22.631ZINFOSledAgent (bootstore): Writing ledger to /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
20462024-12-21T02:50:22.634ZINFOSledAgent (bootstore): Writing ledger to /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
20472024-12-21T02:50:22.636ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
20482024-12-21T02:50:22.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51478 req_id = 177a7e45-160a-4aff-ad8e-aa9265dd46cf response_code = 204 uri = /network-bootstore-config
20492024-12-21T02:50:22.638ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
20502024-12-21T02:50:22.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46539 req_id = 747bbfb4-a5e6-4992-9ce5-5b4a9d7b22fe response_code = 204 uri = /eip-gateways
20512024-12-21T02:50:22.644ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20522024-12-21T02:50:22.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 679 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46539 req_id = 03cc7ca7-9aed-4628-9001-9b3b0b12c036 response_code = 204 uri = /vpc-routes
20532024-12-21T02:50:22.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42488
20542024-12-21T02:50:22.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114205 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39471 req_id = e20bf862-7c9a-4e07-8bbc-b20787651aaa response_code = 204 uri = /switch-ports
20552024-12-21T02:50:22.710ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20562024-12-21T02:50:22.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 636 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39471 req_id = 2762bfb4-979f-4f7a-8c92-305c44051941 response_code = 200 uri = /network-bootstore-config
20572024-12-21T02:50:22.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51017
20582024-12-21T02:50:22.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51017 req_id = aeaf1b58-bbd6-4f2c-9b20-f92378353cf7 response_code = 200 uri = /v2p
20592024-12-21T02:50:22.744ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20602024-12-21T02:50:22.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130626 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42488 req_id = ece9a19e-dcc8-4ab0-bda0-37d0320ca8f1 response_code = 204 uri = /switch-ports
20612024-12-21T02:50:22.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42488 req_id = 09a0e584-5b2c-41ff-aaa4-3821f6cd8a79 response_code = 200 uri = /network-bootstore-config
20622024-12-21T02:50:49.359ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52754
20632024-12-21T02:50:49.359ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52754 req_id = 1c2fe41c-c063-4396-b0d1-ca5dc78816dd response_code = 200 uri = /baseboard
20642024-12-21T02:50:52.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55124
20652024-12-21T02:50:52.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55124 req_id = 8275afdf-e7cb-4893-a10a-ea3825b3b13a response_code = 200 uri = /vpc-routes
20662024-12-21T02:50:52.098ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
20672024-12-21T02:50:52.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55124 req_id = 5a0a5df6-6484-4826-9d30-a537d5fbfe1a response_code = 204 uri = /eip-gateways
20682024-12-21T02:50:52.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64306
20692024-12-21T02:50:52.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64306 req_id = 44ec5eab-72a7-4eb3-a11b-d35388abd86e response_code = 200 uri = /vpc-routes
20702024-12-21T02:50:52.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55124 req_id = b55461d9-ba39-4524-867e-2d3257931d10 response_code = 204 uri = /vpc-routes
20712024-12-21T02:50:52.242ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
20722024-12-21T02:50:52.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64306 req_id = 84af5ac9-2a4d-40d9-b367-2c497388196c response_code = 204 uri = /eip-gateways
20732024-12-21T02:50:52.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41018
20742024-12-21T02:50:52.336ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20752024-12-21T02:50:52.371ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20762024-12-21T02:50:52.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111639 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41018 req_id = 7dc898c8-3ebb-4358-b9c1-dadca203edcc response_code = 204 uri = /switch-ports
20772024-12-21T02:50:52.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59054
20782024-12-21T02:50:52.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45912
20792024-12-21T02:50:52.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41018 req_id = ce168a26-6cd7-4f77-b740-e24349f255a0 response_code = 200 uri = /network-bootstore-config
20802024-12-21T02:50:52.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59054 req_id = 5f762b9d-47f4-45ca-931c-15388c991a3f response_code = 200 uri = /v2p
20812024-12-21T02:50:52.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45912 req_id = c731891e-f1ee-47bb-b630-8ff1aeb162e6 response_code = 200 uri = /v2p
20822024-12-21T02:50:52.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 670 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64306 req_id = a4292c6c-b52b-4d34-b9fe-4f3c6f5e98a0 response_code = 204 uri = /vpc-routes
20832024-12-21T02:50:52.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62152
20842024-12-21T02:50:52.540ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20852024-12-21T02:50:52.581ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20862024-12-21T02:50:52.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104504 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62152 req_id = bee6f09f-0527-4e20-857e-deafcf66262d response_code = 204 uri = /switch-ports
20872024-12-21T02:50:52.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62152 req_id = cb267c3f-6ba9-46d8-936c-ed4613141308 response_code = 200 uri = /network-bootstore-config
20882024-12-21T02:50:52.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65286
20892024-12-21T02:50:52.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65286 req_id = f614aa5c-0bae-46c8-ae69-54052ed66acd response_code = 200 uri = /vpc-routes
20902024-12-21T02:50:52.877ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
20912024-12-21T02:50:52.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65286 req_id = 2ed55bf1-c13f-4925-aa2d-f7820fbf29fa response_code = 204 uri = /eip-gateways
20922024-12-21T02:50:52.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65286 req_id = 257644ba-46e4-4fab-88e0-941c6232da16 response_code = 204 uri = /vpc-routes
20932024-12-21T02:50:52.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53919
20942024-12-21T02:50:52.902ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20952024-12-21T02:50:52.938ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20962024-12-21T02:50:52.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90139 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53919 req_id = 8c611ab9-dcc8-4037-89f6-327700ef80e6 response_code = 204 uri = /switch-ports
20972024-12-21T02:50:52.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32906
20982024-12-21T02:50:52.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32906 req_id = 05e64a3c-eca8-494c-a79f-b5612d7d4f61 response_code = 200 uri = /v2p
20992024-12-21T02:50:52.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53919 req_id = 0357d7a9-f0a7-4e12-beb0-8756099fe2e0 response_code = 200 uri = /network-bootstore-config
21002024-12-21T02:51:04.020ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:43662 remote_addr = [fd00:1122:3344:101::d]:58688 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
21012024-12-21T02:51:04.042ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22332 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 722dd73d-628e-470e-9a46-f7364cb3224b response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
21022024-12-21T02:51:09.029ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
21032024-12-21T02:51:19.394ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48884
21042024-12-21T02:51:19.394ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48884 req_id = 075eaced-fc2d-4749-bd09-c09e0bb3de31 response_code = 200 uri = /baseboard
21052024-12-21T02:51:22.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53636
21062024-12-21T02:51:22.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53636 req_id = f4dfc0d6-d215-49ff-84fc-a54758170e05 response_code = 200 uri = /vpc-routes
21072024-12-21T02:51:22.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59751
21082024-12-21T02:51:22.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59751 req_id = b7370d75-5de2-4b6e-804f-f9a1b6b131dc response_code = 200 uri = /v2p
21092024-12-21T02:51:22.096ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
21102024-12-21T02:51:22.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53636 req_id = afe75865-eef2-48f1-8b9d-f10b6633714c response_code = 204 uri = /eip-gateways
21112024-12-21T02:51:22.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37923
21122024-12-21T02:51:22.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37923 req_id = 7084dc7d-218f-453d-99c0-6e71525defe5 response_code = 200 uri = /vpc-routes
21132024-12-21T02:51:22.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53636 req_id = cb8b76ab-ad7d-4a97-9b8e-c9b58945a33a response_code = 204 uri = /vpc-routes
21142024-12-21T02:51:22.157ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
21152024-12-21T02:51:22.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37923 req_id = 8a885951-e597-421a-9c57-caac77a5ea11 response_code = 204 uri = /eip-gateways
21162024-12-21T02:51:22.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55107
21172024-12-21T02:51:22.157ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21182024-12-21T02:51:22.200ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21192024-12-21T02:51:22.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104330 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55107 req_id = 6da0831e-258b-41aa-91e7-e71ebed6c2ec response_code = 204 uri = /switch-ports
21202024-12-21T02:51:22.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38447
21212024-12-21T02:51:22.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38447 req_id = 984185f5-63af-471e-aaff-84bdced7ebb8 response_code = 200 uri = /v2p
21222024-12-21T02:51:22.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55107 req_id = bc0f785c-9e2d-4c23-b191-a2f662902e4f response_code = 200 uri = /network-bootstore-config
21232024-12-21T02:51:22.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 436 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37923 req_id = b706ba73-8041-432f-bad1-b616e3f94f1f response_code = 204 uri = /vpc-routes
21242024-12-21T02:51:22.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53726
21252024-12-21T02:51:22.271ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21262024-12-21T02:51:22.303ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21272024-12-21T02:51:22.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87705 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53726 req_id = 862e53fe-e1fe-4983-8372-0aaf95786db4 response_code = 204 uri = /switch-ports
21282024-12-21T02:51:22.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53726 req_id = e5ff1121-ac2a-47c9-a93b-d893fb488965 response_code = 200 uri = /network-bootstore-config
21292024-12-21T02:51:22.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35089
21302024-12-21T02:51:22.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35089 req_id = d01c691f-4b07-4907-94c7-18980e6e88c6 response_code = 200 uri = /vpc-routes
21312024-12-21T02:51:22.658ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
21322024-12-21T02:51:22.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35089 req_id = 08e14e58-eeea-4e0e-815c-ff1b3533c037 response_code = 204 uri = /eip-gateways
21332024-12-21T02:51:22.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47110
21342024-12-21T02:51:22.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47110 req_id = cc1e41c1-f0ea-4dae-9e8f-36d0d99cf2a0 response_code = 200 uri = /v2p
21352024-12-21T02:51:22.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35089 req_id = b2d3b850-456b-4f43-8f44-aaac28c97dda response_code = 204 uri = /vpc-routes
21362024-12-21T02:51:22.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44107
21372024-12-21T02:51:22.776ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21382024-12-21T02:51:22.811ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21392024-12-21T02:51:22.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88497 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44107 req_id = c63bce68-05a1-4a32-9a8f-9d3a3f26e54a response_code = 204 uri = /switch-ports
21402024-12-21T02:51:22.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44107 req_id = 97cbad87-ba75-4c06-98da-423be0f56927 response_code = 200 uri = /network-bootstore-config
21412024-12-21T02:51:34.026ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7167 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 39219b9c-dead-436e-b35c-481571b60d02 response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
21422024-12-21T02:51:49.429ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62673
21432024-12-21T02:51:49.429ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62673 req_id = a1a1d5e2-60e4-4dc7-b1bd-a2df978bf0b2 response_code = 200 uri = /baseboard
21442024-12-21T02:51:52.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41616
21452024-12-21T02:51:52.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41616 req_id = b96ccd95-5fd1-40b5-b42e-9902dc019b6b response_code = 200 uri = /vpc-routes
21462024-12-21T02:51:52.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42916
21472024-12-21T02:51:52.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42916 req_id = a89acb04-2147-447f-948d-6a219c643ba1 response_code = 200 uri = /vpc-routes
21482024-12-21T02:51:52.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60367
21492024-12-21T02:51:52.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60367 req_id = 9c4d0f23-a093-4a01-a515-9c8563beda60 response_code = 200 uri = /v2p
21502024-12-21T02:51:52.308ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
21512024-12-21T02:51:52.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42916 req_id = 755b986f-d5ac-4eb6-b563-45d03264773a response_code = 204 uri = /eip-gateways
21522024-12-21T02:51:52.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42916 req_id = 96f86ffd-8689-4d39-9b91-83db0c1e64c4 response_code = 204 uri = /vpc-routes
21532024-12-21T02:51:52.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53131
21542024-12-21T02:51:52.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53131 req_id = 0e49a4f0-bb7b-4f0b-bb84-090dc0e5a94d response_code = 200 uri = /v2p
21552024-12-21T02:51:52.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53666
21562024-12-21T02:51:52.342ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21572024-12-21T02:51:52.379ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21582024-12-21T02:51:52.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116045 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53666 req_id = 285d22ac-b73e-4b95-8722-b29fd84efa81 response_code = 204 uri = /switch-ports
21592024-12-21T02:51:52.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33163
21602024-12-21T02:51:52.458ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
21612024-12-21T02:51:52.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41616 req_id = 193ef9a1-dd6d-4bf0-989a-2f3c6dadf9e5 response_code = 204 uri = /eip-gateways
21622024-12-21T02:51:52.459ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21632024-12-21T02:51:52.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53666 req_id = 1a39a836-c695-49e2-92e6-eaab7f1d3720 response_code = 200 uri = /network-bootstore-config
21642024-12-21T02:51:52.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 478 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41616 req_id = 4f20505d-bdc4-4246-b591-942b81c4a2d9 response_code = 204 uri = /vpc-routes
21652024-12-21T02:51:52.516ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21662024-12-21T02:51:52.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128864 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33163 req_id = 0f7caa47-e376-4016-b66d-0e9721b9c2a1 response_code = 204 uri = /switch-ports
21672024-12-21T02:51:52.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33163 req_id = 6b5bf4f9-1127-48a4-9043-b3310fec7d0a response_code = 200 uri = /network-bootstore-config
21682024-12-21T02:51:52.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45948
21692024-12-21T02:51:52.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45948 req_id = d5075787-680f-499f-9294-a86996b18284 response_code = 200 uri = /vpc-routes
21702024-12-21T02:51:52.977ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
21712024-12-21T02:51:52.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45948 req_id = cbb9b892-5e85-4c86-9145-8f0dbc6e8fd5 response_code = 204 uri = /eip-gateways
21722024-12-21T02:51:52.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45948 req_id = 6565e7a4-07f3-47f7-ba6d-cd8d14e27fe2 response_code = 204 uri = /vpc-routes
21732024-12-21T02:51:53.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33056
21742024-12-21T02:51:53.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33056 req_id = 9c1cf54a-385b-4d57-ba92-c60d123ed6f1 response_code = 200 uri = /v2p
21752024-12-21T02:51:53.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42074
21762024-12-21T02:51:53.018ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21772024-12-21T02:51:53.056ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21782024-12-21T02:51:53.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92864 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42074 req_id = 0b0ef0a3-7cac-4aea-aa2a-43cb9309cc44 response_code = 204 uri = /switch-ports
21792024-12-21T02:51:53.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42074 req_id = 788a4940-1bd5-41d6-b009-6b45b6aaa7fe response_code = 200 uri = /network-bootstore-config
21802024-12-21T02:52:04.026ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6355 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 941cada3-4e9e-448a-b699-611b33ac4c43 response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
21812024-12-21T02:52:19.462ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48192
21822024-12-21T02:52:19.462ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48192 req_id = 607f1914-e9f7-4fb2-9e15-d218f97c971b response_code = 200 uri = /baseboard
21832024-12-21T02:52:22.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47434
21842024-12-21T02:52:22.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47434 req_id = 05eca2ab-62d1-41d6-a7a7-8011eb8d0a59 response_code = 200 uri = /vpc-routes
21852024-12-21T02:52:22.089ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
21862024-12-21T02:52:22.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47434 req_id = 7a48a68e-1081-47e8-ba52-8e7e68437864 response_code = 204 uri = /eip-gateways
21872024-12-21T02:52:22.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47434 req_id = 7a5ac1e2-d173-491e-a984-2eb68157e702 response_code = 204 uri = /vpc-routes
21882024-12-21T02:52:22.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35042
21892024-12-21T02:52:22.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35042 req_id = 0cbd6e48-3c59-4b63-9282-50e8745afaa3 response_code = 200 uri = /vpc-routes
21902024-12-21T02:52:22.171ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
21912024-12-21T02:52:22.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35042 req_id = 90adf7a1-e6a2-4c61-b76d-340719c4fbae response_code = 204 uri = /eip-gateways
21922024-12-21T02:52:22.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35042 req_id = 44f8d48c-3458-45ea-bdaa-d2a5326d1fa3 response_code = 204 uri = /vpc-routes
21932024-12-21T02:52:22.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46808
21942024-12-21T02:52:22.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46808 req_id = 2e2de241-639f-4729-b282-d79731ae2543 response_code = 200 uri = /v2p
21952024-12-21T02:52:22.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53884
21962024-12-21T02:52:22.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53884 req_id = eb2b99a7-a6dc-4aca-872f-6008d16d4484 response_code = 200 uri = /v2p
21972024-12-21T02:52:22.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40735
21982024-12-21T02:52:22.288ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21992024-12-21T02:52:22.326ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22002024-12-21T02:52:22.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93750 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40735 req_id = b0bb1deb-31f2-43b9-8285-cec81d85fc0e response_code = 204 uri = /switch-ports
22012024-12-21T02:52:22.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54075
22022024-12-21T02:52:22.382ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22032024-12-21T02:52:22.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3686 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40735 req_id = e65c7aa0-5a60-4b4f-9c54-3ec794d15f18 response_code = 200 uri = /network-bootstore-config
22042024-12-21T02:52:22.429ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22052024-12-21T02:52:22.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139907 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54075 req_id = 20e245e3-e6c6-4cf3-b21d-2a5d81690528 response_code = 204 uri = /switch-ports
22062024-12-21T02:52:22.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54075 req_id = e74ae197-bb5c-4126-80bf-1f307552e2f6 response_code = 200 uri = /network-bootstore-config
22072024-12-21T02:52:22.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59865
22082024-12-21T02:52:22.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59865 req_id = ae6f803e-d4e8-4913-8bb7-4a43ffc9bc51 response_code = 200 uri = /vpc-routes
22092024-12-21T02:52:22.664ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
22102024-12-21T02:52:22.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59865 req_id = aa04c4e2-1407-4ca4-9c0c-75825d1b6f9d response_code = 204 uri = /eip-gateways
22112024-12-21T02:52:22.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59865 req_id = ed68e7f5-255f-4db6-8165-98c5dc650802 response_code = 204 uri = /vpc-routes
22122024-12-21T02:52:22.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33860
22132024-12-21T02:52:22.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33860 req_id = e1899ea1-ce6a-4efd-9c36-7ecf0b86eac1 response_code = 200 uri = /v2p
22142024-12-21T02:52:22.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61114
22152024-12-21T02:52:22.852ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22162024-12-21T02:52:22.891ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22172024-12-21T02:52:22.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98700 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61114 req_id = 74205e78-4bda-4370-8c91-d786fa13e456 response_code = 204 uri = /switch-ports
22182024-12-21T02:52:22.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61114 req_id = 879d340a-0987-4799-8a70-94fc01929754 response_code = 200 uri = /network-bootstore-config
22192024-12-21T02:52:34.025ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5810 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 1bd3d1b4-d847-4b6a-8d02-79eb38a7f5e9 response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
22202024-12-21T02:52:49.495ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38421
22212024-12-21T02:52:49.496ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38421 req_id = d2accc4b-a42d-4b14-aefd-0f5995504aec response_code = 200 uri = /baseboard
22222024-12-21T02:52:52.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47477
22232024-12-21T02:52:52.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47477 req_id = 94f43692-1dc9-4d54-b49c-9af739a74035 response_code = 200 uri = /vpc-routes
22242024-12-21T02:52:52.276ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
22252024-12-21T02:52:52.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47477 req_id = 792e74c3-f700-489c-9b9f-847f41b7b859 response_code = 204 uri = /eip-gateways
22262024-12-21T02:52:52.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47477 req_id = f1c1d34a-8abd-494e-8575-51523748ceac response_code = 204 uri = /vpc-routes
22272024-12-21T02:52:52.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43749
22282024-12-21T02:52:52.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43749 req_id = bd7e20cd-fc87-42b1-8fae-b2269db4dbea response_code = 200 uri = /vpc-routes
22292024-12-21T02:52:52.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51632
22302024-12-21T02:52:52.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51632 req_id = 557cf8f4-59ca-4dde-a258-55ad60e3a47b response_code = 200 uri = /v2p
22312024-12-21T02:52:52.365ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
22322024-12-21T02:52:52.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43749 req_id = 54925bb1-4449-4cec-aca5-bfa9479a8310 response_code = 204 uri = /eip-gateways
22332024-12-21T02:52:52.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43749 req_id = e006c967-8afc-40bb-9582-a5077d7547df response_code = 204 uri = /vpc-routes
22342024-12-21T02:52:52.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37588
22352024-12-21T02:52:52.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37588 req_id = 66781316-164e-4736-8441-f2cbc9b3ae5f response_code = 200 uri = /v2p
22362024-12-21T02:52:52.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42749
22372024-12-21T02:52:52.498ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22382024-12-21T02:52:52.548ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22392024-12-21T02:52:52.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118332 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42749 req_id = 8fe50d45-06d6-422a-b829-a3a054886698 response_code = 204 uri = /switch-ports
22402024-12-21T02:52:52.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50781
22412024-12-21T02:52:52.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42749 req_id = 9109ece2-3cd5-40dc-8a1e-62902c341cd1 response_code = 200 uri = /network-bootstore-config
22422024-12-21T02:52:52.617ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22432024-12-21T02:52:52.658ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22442024-12-21T02:52:52.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104757 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50781 req_id = 16907d3b-ebb0-4f77-8e85-2b4aae4899d1 response_code = 204 uri = /switch-ports
22452024-12-21T02:52:52.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50781 req_id = 7c9dc53f-075e-40d4-9321-81699612bcf8 response_code = 200 uri = /network-bootstore-config
22462024-12-21T02:52:52.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52493
22472024-12-21T02:52:52.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52493 req_id = f239ba2a-adab-4113-bf14-38ea8a2606c8 response_code = 200 uri = /vpc-routes
22482024-12-21T02:52:52.779ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
22492024-12-21T02:52:52.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52493 req_id = deb1b345-639b-4d10-be9d-a13f164cc7e4 response_code = 204 uri = /eip-gateways
22502024-12-21T02:52:52.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52493 req_id = 6769d0d1-1d6a-4bf6-b940-bbe826f5d4f0 response_code = 204 uri = /vpc-routes
22512024-12-21T02:52:52.900ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58605
22522024-12-21T02:52:52.900ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22532024-12-21T02:52:52.942ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22542024-12-21T02:52:52.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95901 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58605 req_id = 29d8f2eb-c201-4910-8051-dbb01d00b403 response_code = 204 uri = /switch-ports
22552024-12-21T02:52:52.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37805
22562024-12-21T02:52:52.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37805 req_id = 91d84721-d6d6-4c8d-8c77-41d65ef7c690 response_code = 200 uri = /v2p
22572024-12-21T02:52:52.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58605 req_id = 3579db6c-8fff-4cb4-9bb5-5acae8f2ecb4 response_code = 200 uri = /network-bootstore-config
22582024-12-21T02:53:04.026ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6570 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 58f68212-b8d6-4a5d-a8b0-7fd8e1f9d3aa response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
22592024-12-21T02:53:19.528ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58269
22602024-12-21T02:53:19.529ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58269 req_id = dd26704e-f188-42bf-a0a9-e0355ae8bcbd response_code = 200 uri = /baseboard
22612024-12-21T02:53:22.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47223
22622024-12-21T02:53:22.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47223 req_id = 6f25f08e-77d7-43cc-8486-8274cec9d4b2 response_code = 200 uri = /vpc-routes
22632024-12-21T02:53:22.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52666
22642024-12-21T02:53:22.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52666 req_id = 1091a0b1-ad33-4713-a613-2603cbfd850c response_code = 200 uri = /vpc-routes
22652024-12-21T02:53:22.126ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
22662024-12-21T02:53:22.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47223 req_id = 577ccc03-2f99-4211-8c87-b2a15b4b422c response_code = 204 uri = /eip-gateways
22672024-12-21T02:53:22.126ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
22682024-12-21T02:53:22.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 18 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52666 req_id = 9e2cd80a-24e4-4935-b3a2-ddf29cf84da7 response_code = 204 uri = /eip-gateways
22692024-12-21T02:53:22.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47223 req_id = 8eb789a3-cd41-439c-ad5c-0bc1d76780cc response_code = 204 uri = /vpc-routes
22702024-12-21T02:53:22.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52666 req_id = 2d5ba104-4016-41db-84d6-2636d9169a97 response_code = 204 uri = /vpc-routes
22712024-12-21T02:53:22.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41706
22722024-12-21T02:53:22.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41706 req_id = 459cd443-6f12-4253-8479-42b095bd8e90 response_code = 200 uri = /v2p
22732024-12-21T02:53:22.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62903
22742024-12-21T02:53:22.177ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22752024-12-21T02:53:22.217ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22762024-12-21T02:53:22.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97231 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62903 req_id = 8f840461-91fb-4b6f-a6aa-04d565e0de4f response_code = 204 uri = /switch-ports
22772024-12-21T02:53:22.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63439
22782024-12-21T02:53:22.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62903 req_id = eaa0e525-69d9-4f2c-9fe2-1963aabc0fd2 response_code = 200 uri = /network-bootstore-config
22792024-12-21T02:53:22.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63439 req_id = 978ec10f-03ca-4cd7-9072-87c426b47351 response_code = 200 uri = /v2p
22802024-12-21T02:53:22.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55607
22812024-12-21T02:53:22.351ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22822024-12-21T02:53:22.387ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22832024-12-21T02:53:22.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122761 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55607 req_id = 3ededbcf-ee9a-4a90-8337-ec7ee519a854 response_code = 204 uri = /switch-ports
22842024-12-21T02:53:22.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55607 req_id = a05bd6a1-7641-4654-85ae-42138e3a3c07 response_code = 200 uri = /network-bootstore-config
22852024-12-21T02:53:22.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56150
22862024-12-21T02:53:22.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56150 req_id = 47c28f8e-665e-4f7f-a093-9d93b9d59607 response_code = 200 uri = /vpc-routes
22872024-12-21T02:53:22.749ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
22882024-12-21T02:53:22.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56150 req_id = c423f42c-1366-4420-9246-54aacb61c137 response_code = 204 uri = /eip-gateways
22892024-12-21T02:53:22.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56150 req_id = 40d1ccf9-2152-4308-8df7-7b287e956061 response_code = 204 uri = /vpc-routes
22902024-12-21T02:53:22.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35998
22912024-12-21T02:53:22.768ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22922024-12-21T02:53:22.805ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22932024-12-21T02:53:22.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92807 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35998 req_id = 04b0d176-ea22-4f98-aad2-40d6083e8ade response_code = 204 uri = /switch-ports
22942024-12-21T02:53:22.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36027
22952024-12-21T02:53:22.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36027 req_id = 5707e3ad-dc5d-4c3e-8ebb-093d779857bd response_code = 200 uri = /v2p
22962024-12-21T02:53:22.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35998 req_id = 7200e0e0-51d0-45cc-ad55-7f655b19148e response_code = 200 uri = /network-bootstore-config
22972024-12-21T02:53:34.026ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6324 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 6d2b750b-4880-47d6-b3e5-734d348d74b9 response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
22982024-12-21T02:53:49.564ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38090
22992024-12-21T02:53:49.564ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38090 req_id = 500f5424-d69f-495a-9322-93dc64de25dc response_code = 200 uri = /baseboard
23002024-12-21T02:53:52.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60629
23012024-12-21T02:53:52.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60629 req_id = 0abd7954-bb14-4cc5-85b0-f11c586c9275 response_code = 200 uri = /vpc-routes
23022024-12-21T02:53:52.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61455
23032024-12-21T02:53:52.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61455 req_id = 857f124e-2b09-4869-bd7d-e70f4b3fb564 response_code = 200 uri = /vpc-routes
23042024-12-21T02:53:52.231ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
23052024-12-21T02:53:52.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60629 req_id = 8fdfc4b2-1ecc-42e2-a534-a57fbf6bb49e response_code = 204 uri = /eip-gateways
23062024-12-21T02:53:52.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60629 req_id = 7f03adf4-921e-4899-8faf-f45f37b96f8e response_code = 204 uri = /vpc-routes
23072024-12-21T02:53:52.266ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
23082024-12-21T02:53:52.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61455 req_id = 3ad6e70c-966b-401a-92a5-a8093bd86b2d response_code = 204 uri = /eip-gateways
23092024-12-21T02:53:52.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61455 req_id = a1441c95-a2ab-40b2-a03b-05d74f0a4c84 response_code = 204 uri = /vpc-routes
23102024-12-21T02:53:52.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49283
23112024-12-21T02:53:52.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49283 req_id = 19caff56-71b2-409a-bd63-7aa895118928 response_code = 200 uri = /v2p
23122024-12-21T02:53:52.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49243
23132024-12-21T02:53:52.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49243 req_id = f4b01b17-32b5-42ad-bfaa-c292404486f5 response_code = 200 uri = /v2p
23142024-12-21T02:53:52.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35864
23152024-12-21T02:53:52.409ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23162024-12-21T02:53:52.459ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23172024-12-21T02:53:52.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141424 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35864 req_id = b0e42876-2c6e-4a6b-9fc1-b814f7286e1f response_code = 204 uri = /switch-ports
23182024-12-21T02:53:52.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64965
23192024-12-21T02:53:52.550ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23202024-12-21T02:53:52.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35864 req_id = 84f9f85a-617e-49eb-bd5a-6183b84a7cb3 response_code = 200 uri = /network-bootstore-config
23212024-12-21T02:53:52.599ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23222024-12-21T02:53:52.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110644 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64965 req_id = 6584faee-9e70-4662-b828-1b92ab521438 response_code = 204 uri = /switch-ports
23232024-12-21T02:53:52.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64965 req_id = 8e156ad2-3392-44c8-81f3-fe92d149abfc response_code = 200 uri = /network-bootstore-config
23242024-12-21T02:53:52.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35206
23252024-12-21T02:53:52.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35206 req_id = e8ed7c49-2ea0-450f-8ee2-90aec788e33c response_code = 200 uri = /vpc-routes
23262024-12-21T02:53:52.777ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
23272024-12-21T02:53:52.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35206 req_id = 4a1fb22d-ba19-410c-98e9-65928740bc63 response_code = 204 uri = /eip-gateways
23282024-12-21T02:53:52.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35206 req_id = 0dc8aea1-a21c-428a-ab3c-f0eb6918d830 response_code = 204 uri = /vpc-routes
23292024-12-21T02:53:52.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52952
23302024-12-21T02:53:52.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52952 req_id = 9c88bb2a-bd4d-4ef3-a340-77204a2e5e4b response_code = 200 uri = /v2p
23312024-12-21T02:53:53.182ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58041
23322024-12-21T02:53:53.182ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23332024-12-21T02:53:53.218ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23342024-12-21T02:53:53.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87640 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58041 req_id = 652a49bf-43f6-4a90-b7fa-501ac642e3ea response_code = 204 uri = /switch-ports
23352024-12-21T02:53:53.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58041 req_id = c2767310-30d8-4fcc-a3bb-f9bba6a842ae response_code = 200 uri = /network-bootstore-config
23362024-12-21T02:54:04.026ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5999 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 4dd0af8a-6f24-4f43-8828-0a594f10f592 response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23372024-12-21T02:54:19.597ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48203
23382024-12-21T02:54:19.598ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48203 req_id = cc9ee46c-26ea-47ae-8de8-1df059489243 response_code = 200 uri = /baseboard
23392024-12-21T02:54:22.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62017
23402024-12-21T02:54:22.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62017 req_id = ca022892-8493-4b33-8283-31eeee5cc94b response_code = 200 uri = /vpc-routes
23412024-12-21T02:54:22.061ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
23422024-12-21T02:54:22.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62017 req_id = 5f6dd65b-2400-46e5-a566-15cf23b65b40 response_code = 204 uri = /eip-gateways
23432024-12-21T02:54:22.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62017 req_id = 430d5cc6-df00-4f0a-8ad3-3486dfefdacd response_code = 204 uri = /vpc-routes
23442024-12-21T02:54:22.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39478
23452024-12-21T02:54:22.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39478 req_id = d0153150-2289-48a5-8155-766ca1b51da0 response_code = 200 uri = /vpc-routes
23462024-12-21T02:54:22.142ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
23472024-12-21T02:54:22.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39478 req_id = f8507028-3272-4ca4-8e29-df3538cfa2f3 response_code = 204 uri = /eip-gateways
23482024-12-21T02:54:22.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47463
23492024-12-21T02:54:22.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47463 req_id = 1039d95a-80f2-4e1f-baf4-f8763442b5ac response_code = 200 uri = /v2p
23502024-12-21T02:54:22.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39478 req_id = 25b5a998-8989-4c24-ad3e-f73043031ba3 response_code = 204 uri = /vpc-routes
23512024-12-21T02:54:22.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47525
23522024-12-21T02:54:22.202ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23532024-12-21T02:54:22.240ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23542024-12-21T02:54:22.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92883 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47525 req_id = e0335628-06ae-47da-8d88-760490efe209 response_code = 204 uri = /switch-ports
23552024-12-21T02:54:22.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45663
23562024-12-21T02:54:22.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64728
23572024-12-21T02:54:22.295ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23582024-12-21T02:54:22.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3807 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47525 req_id = 8f1320e4-b4ee-45e2-a436-5550522f9ba4 response_code = 200 uri = /network-bootstore-config
23592024-12-21T02:54:22.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3714 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45663 req_id = 10156caa-f5df-4893-bce3-9a265f3c4e77 response_code = 200 uri = /v2p
23602024-12-21T02:54:22.328ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23612024-12-21T02:54:22.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84415 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64728 req_id = aace0035-3ed5-4028-a224-669e513309b2 response_code = 204 uri = /switch-ports
23622024-12-21T02:54:22.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64728 req_id = 8995dcbf-0782-40df-8d5c-10b7f3657701 response_code = 200 uri = /network-bootstore-config
23632024-12-21T02:54:22.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41701
23642024-12-21T02:54:22.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41701 req_id = 9affdc59-e194-4a51-aad4-f06a998088b8 response_code = 200 uri = /vpc-routes
23652024-12-21T02:54:22.674ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
23662024-12-21T02:54:22.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41701 req_id = ec7075d4-13ee-4efb-bd21-137c1ac3b489 response_code = 204 uri = /eip-gateways
23672024-12-21T02:54:22.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41701 req_id = 31b60fd1-f6c7-4bf1-b586-9d08a79064df response_code = 204 uri = /vpc-routes
23682024-12-21T02:54:22.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48565
23692024-12-21T02:54:22.727ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23702024-12-21T02:54:22.759ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23712024-12-21T02:54:22.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85929 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48565 req_id = 98e164b8-e252-48cd-82e4-21ea2cc506da response_code = 204 uri = /switch-ports
23722024-12-21T02:54:22.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60391
23732024-12-21T02:54:22.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48565 req_id = 644414b6-64ae-47cb-81da-bef85f06ac85 response_code = 200 uri = /network-bootstore-config
23742024-12-21T02:54:22.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60391 req_id = 620841c7-f4ca-4179-9a7b-c87209285b36 response_code = 200 uri = /v2p
23752024-12-21T02:54:34.028ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6439 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 64491921-91bd-41f7-9700-12c3a8aa7c8c response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
23762024-12-21T02:54:49.632ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64133
23772024-12-21T02:54:49.632ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64133 req_id = e6e8c02c-ae1d-4440-8fa1-86ba6fec6184 response_code = 200 uri = /baseboard
23782024-12-21T02:54:52.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51467
23792024-12-21T02:54:52.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51467 req_id = c0cdaa1c-9fd7-4519-9931-dba297daee11 response_code = 200 uri = /vpc-routes
23802024-12-21T02:54:52.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44201
23812024-12-21T02:54:52.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44201 req_id = 1eab5093-cada-4779-8bae-a386e9baee76 response_code = 200 uri = /v2p
23822024-12-21T02:54:52.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36808
23832024-12-21T02:54:52.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36808 req_id = 114d70ce-4fa3-4c46-bb3a-8ef9de2a8d0a response_code = 200 uri = /vpc-routes
23842024-12-21T02:54:52.281ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
23852024-12-21T02:54:52.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51467 req_id = 3da9f5c7-8495-4929-9578-7de6e7afb049 response_code = 204 uri = /eip-gateways
23862024-12-21T02:54:52.292ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
23872024-12-21T02:54:52.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36808 req_id = 506b5b9a-72f6-4d0e-a100-227f6dbe2381 response_code = 204 uri = /eip-gateways
23882024-12-21T02:54:52.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51467 req_id = c4fb4bb2-d6f1-4244-9e7b-9f17cd58ca28 response_code = 204 uri = /vpc-routes
23892024-12-21T02:54:52.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36808 req_id = 7242c77f-01f7-4b5f-b4dd-6c82cb1442db response_code = 204 uri = /vpc-routes
23902024-12-21T02:54:52.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40472
23912024-12-21T02:54:52.456ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e6764d0d-89f4-4d8a-aa9a-63a6b6c44f9c, kind: Service { id: 82a0d97c-0396-4dff-a562-7bc3f12f4b4d }, name: Name("external-dns-82a0d97c-0396-4dff-a562-7bc3f12f4b4d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 117])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b4479d-d7bc-48c5-b3c2-7051533d16f5, kind: Service { id: 7d789b63-e234-471f-abd5-426e10c5c6e3 }, name: Name("external-dns-7d789b63-e234-471f-abd5-426e10c5c6e3"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 89])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 86470b3f-1b5e-4e63-bb28-a8ff8c9cee13, kind: Service { id: 4f50fa81-5371-4a88-a8b4-4e3726e451a5 }, name: Name("nexus-4f50fa81-5371-4a88-a8b4-4e3726e451a5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9382bc6b-4023-4b07-839c-d3afc84529d0, kind: Service { id: 5f52ac53-51c8-4771-9e69-2b7ae5f68b33 }, name: Name("nexus-5f52ac53-51c8-4771-9e69-2b7ae5f68b33"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 240])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6053b1c-903b-4570-b781-38175f6759a7, kind: Service { id: dcf56aa4-8d02-4872-82c4-3d769bb7bde8 }, name: Name("nexus-dcf56aa4-8d02-4872-82c4-3d769bb7bde8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23922024-12-21T02:54:52.456ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23932024-12-21T02:54:52.456ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23942024-12-21T02:54:52.456ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23952024-12-21T02:54:52.456ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23962024-12-21T02:54:52.456ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23972024-12-21T02:54:52.456ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23982024-12-21T02:54:52.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 441 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40472 req_id = 6db61594-b454-4df2-942b-9072aea6f73f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23992024-12-21T02:54:52.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43538
24002024-12-21T02:54:52.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43538 req_id = 3b48ff43-3256-4c2f-8c7c-a8fd164abc27 response_code = 200 uri = /v2p
24012024-12-21T02:54:52.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44659
24022024-12-21T02:54:52.500ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24032024-12-21T02:54:52.550ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24042024-12-21T02:54:52.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127337 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44659 req_id = 025604d4-a2f0-432b-b9d2-bbfa4cdfa665 response_code = 204 uri = /switch-ports
24052024-12-21T02:54:52.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38871
24062024-12-21T02:54:52.627ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24072024-12-21T02:54:52.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44659 req_id = f95e548d-995f-4008-af0d-30625b3a44d2 response_code = 200 uri = /network-bootstore-config
24082024-12-21T02:54:52.675ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24092024-12-21T02:54:52.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48278
24102024-12-21T02:54:52.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48278 req_id = abe82c89-ae09-44f6-855c-956bb1bab079 response_code = 200 uri = /vpc-routes
24112024-12-21T02:54:52.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123542 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38871 req_id = 1aa1fe8a-d3bf-43c5-8a92-781e82c0382e response_code = 204 uri = /switch-ports
24122024-12-21T02:54:52.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38871 req_id = 90781309-09d4-46ba-ba82-2d95c33ad92a response_code = 200 uri = /network-bootstore-config
24132024-12-21T02:54:52.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38776
24142024-12-21T02:54:52.758ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e6764d0d-89f4-4d8a-aa9a-63a6b6c44f9c, kind: Service { id: 82a0d97c-0396-4dff-a562-7bc3f12f4b4d }, name: Name("external-dns-82a0d97c-0396-4dff-a562-7bc3f12f4b4d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 117])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b4479d-d7bc-48c5-b3c2-7051533d16f5, kind: Service { id: 7d789b63-e234-471f-abd5-426e10c5c6e3 }, name: Name("external-dns-7d789b63-e234-471f-abd5-426e10c5c6e3"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 89])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 86470b3f-1b5e-4e63-bb28-a8ff8c9cee13, kind: Service { id: 4f50fa81-5371-4a88-a8b4-4e3726e451a5 }, name: Name("nexus-4f50fa81-5371-4a88-a8b4-4e3726e451a5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9382bc6b-4023-4b07-839c-d3afc84529d0, kind: Service { id: 5f52ac53-51c8-4771-9e69-2b7ae5f68b33 }, name: Name("nexus-5f52ac53-51c8-4771-9e69-2b7ae5f68b33"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 240])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6053b1c-903b-4570-b781-38175f6759a7, kind: Service { id: dcf56aa4-8d02-4872-82c4-3d769bb7bde8 }, name: Name("nexus-dcf56aa4-8d02-4872-82c4-3d769bb7bde8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24152024-12-21T02:54:52.758ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24162024-12-21T02:54:52.758ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24172024-12-21T02:54:52.758ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24182024-12-21T02:54:52.758ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24192024-12-21T02:54:52.758ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24202024-12-21T02:54:52.758ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24212024-12-21T02:54:52.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 437 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38776 req_id = 8de284e8-1b30-4f21-a4c5-619a139eda69 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24222024-12-21T02:54:52.759ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
24232024-12-21T02:54:52.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48278 req_id = c823ac0a-40e1-4c57-9253-5a8314f327c5 response_code = 204 uri = /eip-gateways
24242024-12-21T02:54:52.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48278 req_id = bb954ae8-6d39-43e4-bce3-c3e4848f1058 response_code = 204 uri = /vpc-routes
24252024-12-21T02:54:52.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59543
24262024-12-21T02:54:52.863ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24272024-12-21T02:54:52.905ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24282024-12-21T02:54:52.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97567 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59543 req_id = c8305356-ce07-4c9d-894a-9843dd5b9fb6 response_code = 204 uri = /switch-ports
24292024-12-21T02:54:52.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52480
24302024-12-21T02:54:52.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52480 req_id = b249e447-1163-426c-8099-c319b9d427ed response_code = 200 uri = /v2p
24312024-12-21T02:54:52.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59543 req_id = 45484988-953f-4687-98d7-04af9bb8a250 response_code = 200 uri = /network-bootstore-config
24322024-12-21T02:54:53.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63738
24332024-12-21T02:54:53.005ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e6764d0d-89f4-4d8a-aa9a-63a6b6c44f9c, kind: Service { id: 82a0d97c-0396-4dff-a562-7bc3f12f4b4d }, name: Name("external-dns-82a0d97c-0396-4dff-a562-7bc3f12f4b4d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 117])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b4479d-d7bc-48c5-b3c2-7051533d16f5, kind: Service { id: 7d789b63-e234-471f-abd5-426e10c5c6e3 }, name: Name("external-dns-7d789b63-e234-471f-abd5-426e10c5c6e3"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 89])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 86470b3f-1b5e-4e63-bb28-a8ff8c9cee13, kind: Service { id: 4f50fa81-5371-4a88-a8b4-4e3726e451a5 }, name: Name("nexus-4f50fa81-5371-4a88-a8b4-4e3726e451a5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9382bc6b-4023-4b07-839c-d3afc84529d0, kind: Service { id: 5f52ac53-51c8-4771-9e69-2b7ae5f68b33 }, name: Name("nexus-5f52ac53-51c8-4771-9e69-2b7ae5f68b33"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 240])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6053b1c-903b-4570-b781-38175f6759a7, kind: Service { id: dcf56aa4-8d02-4872-82c4-3d769bb7bde8 }, name: Name("nexus-dcf56aa4-8d02-4872-82c4-3d769bb7bde8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24342024-12-21T02:54:53.005ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24352024-12-21T02:54:53.005ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24362024-12-21T02:54:53.005ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24372024-12-21T02:54:53.005ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24382024-12-21T02:54:53.005ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24392024-12-21T02:54:53.005ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24402024-12-21T02:54:53.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 397 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63738 req_id = ee81f2c7-fbe4-43f8-aac7-14901978039b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24412024-12-21T02:55:04.027ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6106 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = fdbdac50-8ca3-4092-8d15-c9acaf2891b4 response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
24422024-12-21T02:55:19.666ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53326
24432024-12-21T02:55:19.666ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53326 req_id = ef306d7e-1594-4b11-9ff1-570d6ca43d07 response_code = 200 uri = /baseboard
24442024-12-21T02:55:22.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47681
24452024-12-21T02:55:22.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47681 req_id = 39e97c7b-cf9f-48e5-b1ca-731f9450c395 response_code = 200 uri = /v2p
24462024-12-21T02:55:22.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36519
24472024-12-21T02:55:22.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36519 req_id = 49530a60-4241-4c28-bc2e-c0c9f447ca94 response_code = 200 uri = /vpc-routes
24482024-12-21T02:55:22.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58942
24492024-12-21T02:55:22.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58942 req_id = 32fed446-762d-4ea5-91d9-fd951b5172c8 response_code = 200 uri = /vpc-routes
24502024-12-21T02:55:22.090ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
24512024-12-21T02:55:22.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58942 req_id = 81c00555-a3d6-4b11-af49-8deb9d193f54 response_code = 204 uri = /eip-gateways
24522024-12-21T02:55:22.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58942 req_id = 9f0db0c4-773c-4859-b472-1df61a153b26 response_code = 204 uri = /vpc-routes
24532024-12-21T02:55:22.113ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
24542024-12-21T02:55:22.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36519 req_id = 561c9e90-3d16-4370-a06b-aa01b065a8b6 response_code = 204 uri = /eip-gateways
24552024-12-21T02:55:22.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43497
24562024-12-21T02:55:22.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43497 req_id = 4f8e8520-bbc3-418b-87a2-72bfb46d35c2 response_code = 200 uri = /v2p
24572024-12-21T02:55:22.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36519 req_id = 9769406f-b965-459f-bda8-22c5469c5fef response_code = 204 uri = /vpc-routes
24582024-12-21T02:55:22.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58094
24592024-12-21T02:55:22.155ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24602024-12-21T02:55:22.195ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24612024-12-21T02:55:22.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96499 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58094 req_id = 0df75b97-8e3a-4507-b5f3-473748ec3688 response_code = 204 uri = /switch-ports
24622024-12-21T02:55:22.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39444
24632024-12-21T02:55:22.252ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24642024-12-21T02:55:22.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3642 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58094 req_id = eafe0341-d7fa-4398-b453-4f088933485b response_code = 200 uri = /network-bootstore-config
24652024-12-21T02:55:22.291ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24662024-12-21T02:55:22.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91777 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39444 req_id = ce4f13df-310f-43d4-8238-5c1ac19c37af response_code = 204 uri = /switch-ports
24672024-12-21T02:55:22.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39444 req_id = c0d6c5e3-1ad8-4889-ab92-ef8b7a54b4f6 response_code = 200 uri = /network-bootstore-config
24682024-12-21T02:55:22.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61588
24692024-12-21T02:55:22.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61588 req_id = 6dcdd546-5361-4623-83f0-1bd246dc1268 response_code = 200 uri = /vpc-routes
24702024-12-21T02:55:22.616ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
24712024-12-21T02:55:22.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61588 req_id = 26d3dc3b-5158-4160-913a-0659d905ab83 response_code = 204 uri = /eip-gateways
24722024-12-21T02:55:22.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52286
24732024-12-21T02:55:22.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52286 req_id = 93b04308-3e90-4745-bc52-57c7c8ace06e response_code = 200 uri = /v2p
24742024-12-21T02:55:22.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61588 req_id = f6471c07-90ee-4141-96c9-f4fc8bd9aa7f response_code = 204 uri = /vpc-routes
24752024-12-21T02:55:22.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54569
24762024-12-21T02:55:22.701ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24772024-12-21T02:55:22.741ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24782024-12-21T02:55:22.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96751 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54569 req_id = e595688f-a486-4cd3-b088-66751225712d response_code = 204 uri = /switch-ports
24792024-12-21T02:55:22.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54569 req_id = ec307487-4c17-48ff-8361-797970705dc3 response_code = 200 uri = /network-bootstore-config
24802024-12-21T02:55:34.027ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5854 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 59258238-dc76-49ff-83c0-799259153b37 response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
24812024-12-21T02:55:49.700ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48183
24822024-12-21T02:55:49.700ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48183 req_id = 4c30e079-d6a3-4e13-8858-293acd91536d response_code = 200 uri = /baseboard
24832024-12-21T02:55:52.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57057
24842024-12-21T02:55:52.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57057 req_id = d5fd1595-59db-4da8-8d17-25ecac001773 response_code = 200 uri = /vpc-routes
24852024-12-21T02:55:52.147ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
24862024-12-21T02:55:52.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57057 req_id = 11619b55-8c11-4065-8481-c9abeb07b5c0 response_code = 204 uri = /eip-gateways
24872024-12-21T02:55:52.182ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62622
24882024-12-21T02:55:52.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62622 req_id = 1c4fb896-c6fb-4c8c-b0bd-dcc41a1e2bd4 response_code = 200 uri = /vpc-routes
24892024-12-21T02:55:52.196ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
24902024-12-21T02:55:52.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62622 req_id = e08a7d6f-815e-44c3-aeaa-d4c139be8a15 response_code = 204 uri = /eip-gateways
24912024-12-21T02:55:52.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63882
24922024-12-21T02:55:52.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63882 req_id = ad0c3bdc-46b9-443c-be66-a941f6e0b847 response_code = 200 uri = /v2p
24932024-12-21T02:55:52.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62622 req_id = 1e98ef9e-7c43-4c62-9fc1-4519c3a7aa10 response_code = 204 uri = /vpc-routes
24942024-12-21T02:55:52.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54774
24952024-12-21T02:55:52.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54774 req_id = 06742480-a492-4195-8b22-9a317881d78f response_code = 200 uri = /v2p
24962024-12-21T02:55:52.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57057 req_id = a44100a7-97ac-46b2-abbe-7e57c95ef9e2 response_code = 204 uri = /vpc-routes
24972024-12-21T02:55:52.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41757
24982024-12-21T02:55:52.381ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24992024-12-21T02:55:52.426ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25002024-12-21T02:55:52.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145744 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41757 req_id = 2868a078-7dcd-4f3d-835d-8262603d080b response_code = 204 uri = /switch-ports
25012024-12-21T02:55:52.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50390
25022024-12-21T02:55:52.527ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25032024-12-21T02:55:52.575ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25042024-12-21T02:55:52.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115703 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50390 req_id = 2b97ea99-3402-4d64-bb1c-14393c118b8f response_code = 204 uri = /switch-ports
25052024-12-21T02:55:52.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41757 req_id = 290f4b0b-6d5a-4d5a-8134-5adf5f0f989c response_code = 200 uri = /network-bootstore-config
25062024-12-21T02:55:52.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50390 req_id = 11cd9721-5f79-4baa-a2d2-6c5f4169f0e1 response_code = 200 uri = /network-bootstore-config
25072024-12-21T02:55:52.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49963
25082024-12-21T02:55:52.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49963 req_id = ebbe02e3-c75c-4250-821d-ba8728537630 response_code = 200 uri = /vpc-routes
25092024-12-21T02:55:52.782ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
25102024-12-21T02:55:52.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49963 req_id = 021513ca-a700-4e8a-9a9c-a10c97bf3f70 response_code = 204 uri = /eip-gateways
25112024-12-21T02:55:52.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49963 req_id = f2ef38dd-c9da-4b66-8755-afa17eb056b6 response_code = 204 uri = /vpc-routes
25122024-12-21T02:55:52.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33787
25132024-12-21T02:55:52.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33787 req_id = a4380ef3-2b17-44a1-8f30-2708407f9981 response_code = 200 uri = /v2p
25142024-12-21T02:55:53.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36520
25152024-12-21T02:55:53.048ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25162024-12-21T02:55:53.087ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25172024-12-21T02:55:53.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94236 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36520 req_id = d33bcec2-e571-461e-a1a1-4a69eb2d276c response_code = 204 uri = /switch-ports
25182024-12-21T02:55:53.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36520 req_id = b351813f-0765-44ee-ada4-5c18b875bb7b response_code = 200 uri = /network-bootstore-config
25192024-12-21T02:55:54.823ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
25202024-12-21T02:55:54.823ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25212024-12-21T02:55:54.857ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2000, tv_nsec: 917281870 } time_to_next_cleanup = 599.999996729s
25222024-12-21T02:56:04.028ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6951 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 046f74f8-7fa2-4317-be4b-5bc977d38724 response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
25232024-12-21T02:56:09.032ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
25242024-12-21T02:56:19.735ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33552
25252024-12-21T02:56:19.735ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33552 req_id = da19c461-f918-41b2-b3e5-5de7126a3466 response_code = 200 uri = /baseboard
25262024-12-21T02:56:22.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59259
25272024-12-21T02:56:22.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59259 req_id = 17c43fcd-4b85-4dd1-a514-a2d234945acb response_code = 200 uri = /vpc-routes
25282024-12-21T02:56:22.116ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
25292024-12-21T02:56:22.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59259 req_id = c3a349a8-a125-49c7-8678-a536a2e5ec5c response_code = 204 uri = /eip-gateways
25302024-12-21T02:56:22.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59259 req_id = a2f20f2d-c9ec-4633-9f45-ea37457b788a response_code = 204 uri = /vpc-routes
25312024-12-21T02:56:22.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45846
25322024-12-21T02:56:22.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45846 req_id = ed131bd3-c8bf-4437-8c22-2236e7f3495c response_code = 200 uri = /vpc-routes
25332024-12-21T02:56:22.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45893
25342024-12-21T02:56:22.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25352024-12-21T02:56:22.201ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25362024-12-21T02:56:22.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101650 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45893 req_id = 8a0c9a9e-91dc-432f-98cb-395c5c2b29d6 response_code = 204 uri = /switch-ports
25372024-12-21T02:56:22.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44768
25382024-12-21T02:56:22.261ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
25392024-12-21T02:56:22.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45846 req_id = 3075c46d-2164-4485-b963-43cf3e942546 response_code = 204 uri = /eip-gateways
25402024-12-21T02:56:22.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45893 req_id = da824eeb-8d2b-4083-ad71-b3a79f56b662 response_code = 200 uri = /network-bootstore-config
25412024-12-21T02:56:22.261ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25422024-12-21T02:56:22.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55475
25432024-12-21T02:56:22.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37947
25442024-12-21T02:56:22.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37947 req_id = 592d2520-bdd4-46ff-bae0-29c4c257f6d9 response_code = 200 uri = /v2p
25452024-12-21T02:56:22.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 383 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55475 req_id = 33d3d39f-484f-4c5b-983f-9c95c35adf6c response_code = 200 uri = /v2p
25462024-12-21T02:56:22.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45846 req_id = 57d17b07-4164-4299-9602-ab7008a42c2d response_code = 204 uri = /vpc-routes
25472024-12-21T02:56:22.300ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25482024-12-21T02:56:22.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92415 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44768 req_id = ada88f3f-61ee-4b6d-a791-079478436bb4 response_code = 204 uri = /switch-ports
25492024-12-21T02:56:22.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44768 req_id = 31b9a9f2-a376-41ed-9db7-444670665973 response_code = 200 uri = /network-bootstore-config
25502024-12-21T02:56:22.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50110
25512024-12-21T02:56:22.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50110 req_id = b6773aaa-2ba0-4c92-93e9-b0a772664f93 response_code = 200 uri = /vpc-routes
25522024-12-21T02:56:22.645ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
25532024-12-21T02:56:22.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50110 req_id = e131d5ae-ba9c-4f93-ad8c-5180312a33a0 response_code = 204 uri = /eip-gateways
25542024-12-21T02:56:22.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50110 req_id = 72bc28dd-93b5-417e-a778-8442b85971d0 response_code = 204 uri = /vpc-routes
25552024-12-21T02:56:22.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49250
25562024-12-21T02:56:22.693ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25572024-12-21T02:56:22.733ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25582024-12-21T02:56:22.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93803 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49250 req_id = 483cbc0a-aac0-4805-904e-5198996b3756 response_code = 204 uri = /switch-ports
25592024-12-21T02:56:22.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49250 req_id = 72136404-470c-43a6-a0dd-5826316d551e response_code = 200 uri = /network-bootstore-config
25602024-12-21T02:56:22.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41297
25612024-12-21T02:56:22.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41297 req_id = 199b9a4d-f7be-423e-ac60-f6222d3deac1 response_code = 200 uri = /v2p
25622024-12-21T02:56:34.028ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6437 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 42d5aced-190c-4f6a-828f-e02113a3528c response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
25632024-12-21T02:56:49.768ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50689
25642024-12-21T02:56:49.768ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50689 req_id = 4ccf7e4f-86a9-439b-8aa5-38f12fd841c8 response_code = 200 uri = /baseboard
25652024-12-21T02:56:52.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52346
25662024-12-21T02:56:52.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52346 req_id = 7e490fcd-c1fe-45ed-8164-ada0d03b84bd response_code = 200 uri = /vpc-routes
25672024-12-21T02:56:52.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53646
25682024-12-21T02:56:52.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53646 req_id = 1eaa33dc-fba3-4c98-981b-4bd933f3dffb response_code = 200 uri = /vpc-routes
25692024-12-21T02:56:52.251ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
25702024-12-21T02:56:52.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52346 req_id = 3ae68544-8f8d-40dd-955a-b8256003a138 response_code = 204 uri = /eip-gateways
25712024-12-21T02:56:52.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52346 req_id = ee3eb9c3-9f5d-488c-8632-ecb81e47ac96 response_code = 204 uri = /vpc-routes
25722024-12-21T02:56:52.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41373
25732024-12-21T02:56:52.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41373 req_id = aa35bf7e-4107-46ab-8613-7164aecc5d66 response_code = 200 uri = /v2p
25742024-12-21T02:56:52.302ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
25752024-12-21T02:56:52.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53646 req_id = 5bd5432a-9965-4a72-ad7c-5bd40b6f1d0e response_code = 204 uri = /eip-gateways
25762024-12-21T02:56:52.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53646 req_id = b835a6da-175b-4c46-a42f-dd85df80c104 response_code = 204 uri = /vpc-routes
25772024-12-21T02:56:52.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37137
25782024-12-21T02:56:52.331ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25792024-12-21T02:56:52.370ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25802024-12-21T02:56:52.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116897 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37137 req_id = 78a352c3-857b-4c91-9d71-93cbb3b40763 response_code = 204 uri = /switch-ports
25812024-12-21T02:56:52.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42766
25822024-12-21T02:56:52.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39698
25832024-12-21T02:56:52.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37137 req_id = bda5a255-5c71-49a1-9c68-5a42d66a2ee5 response_code = 200 uri = /network-bootstore-config
25842024-12-21T02:56:52.449ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25852024-12-21T02:56:52.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6509 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42766 req_id = 4d20ed32-1596-48f7-a9a8-afbe9aea01ed response_code = 200 uri = /v2p
25862024-12-21T02:56:52.505ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25872024-12-21T02:56:52.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129533 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39698 req_id = 8ed49214-f4b8-4d5d-a4b8-00ac92bd76ca response_code = 204 uri = /switch-ports
25882024-12-21T02:56:52.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39698 req_id = d38a3c22-419f-4955-94e1-4b85a6840df3 response_code = 200 uri = /network-bootstore-config
25892024-12-21T02:56:52.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50532
25902024-12-21T02:56:52.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50532 req_id = df92bf01-b3e5-4f3d-aa03-9b0c8aca0f76 response_code = 200 uri = /vpc-routes
25912024-12-21T02:56:52.864ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
25922024-12-21T02:56:52.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50532 req_id = 207ba98b-ab93-45b3-926f-ebeeaa231843 response_code = 204 uri = /eip-gateways
25932024-12-21T02:56:52.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50532 req_id = 319d04dd-8c26-4888-ac5b-a7dd7a6a25bb response_code = 204 uri = /vpc-routes
25942024-12-21T02:56:52.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58394
25952024-12-21T02:56:52.885ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25962024-12-21T02:56:52.924ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25972024-12-21T02:56:52.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95510 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58394 req_id = 8e9c2bbf-7ee1-4ef8-aec2-34cb63656531 response_code = 204 uri = /switch-ports
25982024-12-21T02:56:52.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35083
25992024-12-21T02:56:52.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35083 req_id = 764375ee-9964-457a-b1c1-459d5a4e4114 response_code = 200 uri = /v2p
26002024-12-21T02:56:52.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58394 req_id = a85e6234-ccc9-46cf-9972-44e6ba122180 response_code = 200 uri = /network-bootstore-config
26012024-12-21T02:57:04.030ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7447 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 37acd224-ce57-498c-bb9d-d4225eca5a3c response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26022024-12-21T02:57:19.803ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57322
26032024-12-21T02:57:19.804ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57322 req_id = ba36f387-e2cc-4476-bd0d-1135f1dda507 response_code = 200 uri = /baseboard
26042024-12-21T02:57:22.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62929
26052024-12-21T02:57:22.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62929 req_id = 5cf3ba32-35f6-437e-86dd-a9670bfccad2 response_code = 200 uri = /vpc-routes
26062024-12-21T02:57:22.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59615
26072024-12-21T02:57:22.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59615 req_id = 74a8193d-1157-4db2-aeca-072c9201be32 response_code = 200 uri = /vpc-routes
26082024-12-21T02:57:22.137ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
26092024-12-21T02:57:22.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62929 req_id = cea0fd48-ae8e-44e2-8df1-8b4f0ca67edf response_code = 204 uri = /eip-gateways
26102024-12-21T02:57:22.141ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
26112024-12-21T02:57:22.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59615 req_id = e332a10a-e6f6-42ac-a128-5f229bb793e9 response_code = 204 uri = /eip-gateways
26122024-12-21T02:57:22.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62929 req_id = 8a488231-355d-4d5d-ae77-c0297302d159 response_code = 204 uri = /vpc-routes
26132024-12-21T02:57:22.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59615 req_id = 46cd77a9-5bc8-4715-b62d-de417ac471d2 response_code = 204 uri = /vpc-routes
26142024-12-21T02:57:22.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55860
26152024-12-21T02:57:22.192ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26162024-12-21T02:57:22.230ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26172024-12-21T02:57:22.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96682 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55860 req_id = 782f864a-60ad-4d95-9816-8fd5b8d0ade8 response_code = 204 uri = /switch-ports
26182024-12-21T02:57:22.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60543
26192024-12-21T02:57:22.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52290
26202024-12-21T02:57:22.289ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26212024-12-21T02:57:22.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55860 req_id = a1c46c0f-5670-4275-b317-7a57ecda35bd response_code = 200 uri = /network-bootstore-config
26222024-12-21T02:57:22.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3517 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60543 req_id = 67f27271-00ce-4f77-8a2a-f9a19221c144 response_code = 200 uri = /v2p
26232024-12-21T02:57:22.317ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55384
26242024-12-21T02:57:22.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55384 req_id = 4cd4923c-fd7e-4022-b4c2-5bb063f2a574 response_code = 200 uri = /v2p
26252024-12-21T02:57:22.324ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26262024-12-21T02:57:22.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87637 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52290 req_id = a2205945-d7f9-4854-aabb-873c62490453 response_code = 204 uri = /switch-ports
26272024-12-21T02:57:22.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52290 req_id = f576dd86-8b75-4faa-98bd-2cd40763a596 response_code = 200 uri = /network-bootstore-config
26282024-12-21T02:57:22.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57100
26292024-12-21T02:57:22.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57100 req_id = 7946e049-18c4-4d03-b266-f85a9e09c696 response_code = 200 uri = /vpc-routes
26302024-12-21T02:57:22.611ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
26312024-12-21T02:57:22.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57100 req_id = 3b305b21-f0f2-4e6c-a306-316d357863cd response_code = 204 uri = /eip-gateways
26322024-12-21T02:57:22.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57100 req_id = c628fdc7-5dc1-42cc-80cf-717d1daf64cd response_code = 204 uri = /vpc-routes
26332024-12-21T02:57:22.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53647
26342024-12-21T02:57:22.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53647 req_id = a0c2d08c-9854-46ea-90db-bbf50b9a8f90 response_code = 200 uri = /v2p
26352024-12-21T02:57:22.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61958
26362024-12-21T02:57:22.708ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26372024-12-21T02:57:22.746ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26382024-12-21T02:57:22.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91953 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61958 req_id = 11a45cb4-315f-4ce1-b725-76672cfeb8b9 response_code = 204 uri = /switch-ports
26392024-12-21T02:57:22.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61958 req_id = 01fa239d-60bf-4b24-a684-c5fb27deeca0 response_code = 200 uri = /network-bootstore-config
26402024-12-21T02:57:34.028ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6185 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 43ee5732-9f3f-494f-81b4-6098a60b6ad8 response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26412024-12-21T02:57:49.836ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41068
26422024-12-21T02:57:49.836ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41068 req_id = fe3d5d15-a556-4154-bf9a-e5a887885dba response_code = 200 uri = /baseboard
26432024-12-21T02:57:52.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47375
26442024-12-21T02:57:52.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47375 req_id = d4be8afc-cb51-4a49-9de3-9913c66af3f5 response_code = 200 uri = /vpc-routes
26452024-12-21T02:57:52.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64728
26462024-12-21T02:57:52.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64728 req_id = 8e7b5930-3ed1-4819-b986-01662acec1cf response_code = 200 uri = /vpc-routes
26472024-12-21T02:57:52.308ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
26482024-12-21T02:57:52.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64728 req_id = 015902a9-1b35-4d19-902e-b77e0742e6da response_code = 204 uri = /eip-gateways
26492024-12-21T02:57:52.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64728 req_id = 6150e36d-8e06-4847-ac9f-6d9fb7b26511 response_code = 204 uri = /vpc-routes
26502024-12-21T02:57:52.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42957
26512024-12-21T02:57:52.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42957 req_id = d8de607d-4bc8-46f5-b3f6-2c2fe9693a9e response_code = 200 uri = /v2p
26522024-12-21T02:57:52.383ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
26532024-12-21T02:57:52.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47375 req_id = 3797179c-0e6e-4809-bb80-1e60731e6100 response_code = 204 uri = /eip-gateways
26542024-12-21T02:57:52.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49622
26552024-12-21T02:57:52.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49622 req_id = 80f33b3f-cc5f-4d8c-9863-4839c6141b92 response_code = 200 uri = /v2p
26562024-12-21T02:57:52.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47375 req_id = 8c37a48b-7c60-4cd4-bf53-03013d1b8663 response_code = 204 uri = /vpc-routes
26572024-12-21T02:57:52.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34740
26582024-12-21T02:57:52.439ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26592024-12-21T02:57:52.493ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26602024-12-21T02:57:52.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129057 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34740 req_id = 2c0b9f17-3f8f-4fa2-84cf-b0b2c7949c5a response_code = 204 uri = /switch-ports
26612024-12-21T02:57:52.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53275
26622024-12-21T02:57:52.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34740 req_id = cb5128b2-be05-466a-9bd7-9914e680c3f2 response_code = 200 uri = /network-bootstore-config
26632024-12-21T02:57:52.569ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26642024-12-21T02:57:52.616ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26652024-12-21T02:57:52.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41631
26662024-12-21T02:57:52.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41631 req_id = f9cec7f3-f33d-43f3-ba63-3b6dfae3a908 response_code = 200 uri = /vpc-routes
26672024-12-21T02:57:52.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109861 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53275 req_id = 4b2abe03-9cca-4566-962b-8c35e62191f4 response_code = 204 uri = /switch-ports
26682024-12-21T02:57:52.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53275 req_id = 22e2817a-322a-46a7-b4ba-f3999ad3500f response_code = 200 uri = /network-bootstore-config
26692024-12-21T02:57:52.716ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
26702024-12-21T02:57:52.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41631 req_id = c6359155-d7ff-43a4-9ec9-86871dc6ab95 response_code = 204 uri = /eip-gateways
26712024-12-21T02:57:52.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47068
26722024-12-21T02:57:52.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47068 req_id = ec209331-9a76-43c4-9340-736cbff23f60 response_code = 200 uri = /v2p
26732024-12-21T02:57:52.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41631 req_id = c3fd75f9-49fb-4296-9c17-920db8be6532 response_code = 204 uri = /vpc-routes
26742024-12-21T02:57:52.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35477
26752024-12-21T02:57:52.933ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26762024-12-21T02:57:52.974ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26772024-12-21T02:57:53.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98728 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35477 req_id = 2804d6db-6f42-4b26-9db1-e4db3ce2a74f response_code = 204 uri = /switch-ports
26782024-12-21T02:57:53.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35477 req_id = 6a149ad0-0b03-41fc-bfa0-7e3bc261b0aa response_code = 200 uri = /network-bootstore-config
26792024-12-21T02:58:04.030ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7799 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 7af8835b-1369-4622-beb3-64a9d69b6936 response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
26802024-12-21T02:58:19.869ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53319
26812024-12-21T02:58:19.869ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53319 req_id = 07ab3eef-3ea1-43f2-8aef-17f0f337f9fa response_code = 200 uri = /baseboard
26822024-12-21T02:58:21.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35464
26832024-12-21T02:58:21.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35464 req_id = d8c5d8f0-f2c7-426c-accd-a47e8251203f response_code = 200 uri = /vpc-routes
26842024-12-21T02:58:22.020ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
26852024-12-21T02:58:22.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35464 req_id = 40503fbc-ca31-4b32-a78c-659f016ed1bb response_code = 204 uri = /eip-gateways
26862024-12-21T02:58:22.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37494
26872024-12-21T02:58:22.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37494 req_id = fc896047-750f-4642-9a46-0ee8c8184556 response_code = 200 uri = /v2p
26882024-12-21T02:58:22.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35464 req_id = 69076ccc-4739-4b7b-9719-a8f4c6d10602 response_code = 204 uri = /vpc-routes
26892024-12-21T02:58:22.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57341
26902024-12-21T02:58:22.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57341 req_id = e6641eae-b198-4962-9a99-1e105fad1b7d response_code = 200 uri = /vpc-routes
26912024-12-21T02:58:22.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33681
26922024-12-21T02:58:22.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26932024-12-21T02:58:22.196ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26942024-12-21T02:58:22.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92373 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33681 req_id = e45d610c-110e-43e2-a8d1-bd37809f9851 response_code = 204 uri = /switch-ports
26952024-12-21T02:58:22.252ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
26962024-12-21T02:58:22.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57341 req_id = 17e18680-578d-4133-8271-c0237b91d73b response_code = 204 uri = /eip-gateways
26972024-12-21T02:58:22.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33681 req_id = 79e8470d-b21b-41a4-9ae0-65a357f4e618 response_code = 200 uri = /network-bootstore-config
26982024-12-21T02:58:22.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35504
26992024-12-21T02:58:22.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35504 req_id = 10b1c49c-831b-493d-a6d0-2cba1d21eaa9 response_code = 200 uri = /v2p
27002024-12-21T02:58:22.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57341 req_id = d33d151d-535d-424c-ad8a-6faefc1d9238 response_code = 204 uri = /vpc-routes
27012024-12-21T02:58:22.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53900
27022024-12-21T02:58:22.335ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27032024-12-21T02:58:22.370ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27042024-12-21T02:58:22.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98508 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53900 req_id = 2a45334e-b4ea-4471-8bb4-595f934846bd response_code = 204 uri = /switch-ports
27052024-12-21T02:58:22.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53900 req_id = e9aed117-121d-4cb0-9645-58f09e42259b response_code = 200 uri = /network-bootstore-config
27062024-12-21T02:58:22.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60201
27072024-12-21T02:58:22.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60201 req_id = 29f11eff-0a55-403b-b330-b3032e13b358 response_code = 200 uri = /vpc-routes
27082024-12-21T02:58:22.619ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
27092024-12-21T02:58:22.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60201 req_id = 5530f8f3-3794-4532-a330-ec8e2987fe4e response_code = 204 uri = /eip-gateways
27102024-12-21T02:58:22.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60201 req_id = 89e40c19-9d57-4831-b5c8-9870b9f49dbc response_code = 204 uri = /vpc-routes
27112024-12-21T02:58:22.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42567
27122024-12-21T02:58:22.706ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27132024-12-21T02:58:22.745ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27142024-12-21T02:58:22.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99090 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42567 req_id = a82e587f-7dd6-4011-8b21-5618bdc591ec response_code = 204 uri = /switch-ports
27152024-12-21T02:58:22.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56825
27162024-12-21T02:58:22.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56825 req_id = a748ab76-64ce-44b8-895b-1ca2e380d445 response_code = 200 uri = /v2p
27172024-12-21T02:58:22.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42567 req_id = 9c1a15e3-32d1-4163-914d-7f901a812215 response_code = 200 uri = /network-bootstore-config
27182024-12-21T02:58:34.028ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6127 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 9d336faa-71ec-47fa-9ae2-6b25c0f3dad6 response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27192024-12-21T02:58:49.903ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63151
27202024-12-21T02:58:49.903ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63151 req_id = 527600e1-19d6-4ebd-86fc-9054cb01972e response_code = 200 uri = /baseboard
27212024-12-21T02:58:52.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44678
27222024-12-21T02:58:52.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44678 req_id = 26d6a058-47dc-43a6-bed7-5092f5e6a927 response_code = 200 uri = /vpc-routes
27232024-12-21T02:58:52.198ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
27242024-12-21T02:58:52.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44678 req_id = e44a4645-2fdf-4653-8f9c-a93e97164e7d response_code = 204 uri = /eip-gateways
27252024-12-21T02:58:52.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44678 req_id = 12fd46ca-8b60-43f2-8de3-cc1acc76f97c response_code = 204 uri = /vpc-routes
27262024-12-21T02:58:52.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56067
27272024-12-21T02:58:52.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56067 req_id = 1d503133-0157-4de9-a85c-b510d1b3eee6 response_code = 200 uri = /vpc-routes
27282024-12-21T02:58:52.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59049
27292024-12-21T02:58:52.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59049 req_id = 39c11f5d-dfb3-4720-9f73-f7b7e8bf2125 response_code = 200 uri = /v2p
27302024-12-21T02:58:52.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61154
27312024-12-21T02:58:52.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61154 req_id = 19f6114c-c99b-4ca3-b0e8-3fa49ad672c8 response_code = 200 uri = /v2p
27322024-12-21T02:58:52.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54531
27332024-12-21T02:58:52.394ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27342024-12-21T02:58:52.447ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27352024-12-21T02:58:52.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135335 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54531 req_id = eda4b82c-df36-435f-a5e7-74fa340e1b49 response_code = 204 uri = /switch-ports
27362024-12-21T02:58:52.530ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
27372024-12-21T02:58:52.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62742
27382024-12-21T02:58:52.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56067 req_id = 412476d5-8751-4ad9-bb3c-f54a931a8253 response_code = 204 uri = /eip-gateways
27392024-12-21T02:58:52.530ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27402024-12-21T02:58:52.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54531 req_id = 896331e3-a9f0-4173-b104-6f7c221ed088 response_code = 200 uri = /network-bootstore-config
27412024-12-21T02:58:52.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 470 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56067 req_id = 548317cf-c575-45b3-a161-3fc6afc0d5ca response_code = 204 uri = /vpc-routes
27422024-12-21T02:58:52.577ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27432024-12-21T02:58:52.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106978 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62742 req_id = d8748e41-aa7c-4be5-bb71-96de7ac6c017 response_code = 204 uri = /switch-ports
27442024-12-21T02:58:52.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62742 req_id = 796a3772-f154-4164-a625-fc4ac58d14ec response_code = 200 uri = /network-bootstore-config
27452024-12-21T02:58:52.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56863
27462024-12-21T02:58:52.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56863 req_id = 5127078e-06de-443b-ab53-42a06bf54d16 response_code = 200 uri = /vpc-routes
27472024-12-21T02:58:52.770ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
27482024-12-21T02:58:52.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56863 req_id = 1b7512f8-dbe0-4fe3-a09b-88b68adaa1ae response_code = 204 uri = /eip-gateways
27492024-12-21T02:58:52.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57937
27502024-12-21T02:58:52.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57937 req_id = 0adaa7a3-b61b-4ebb-9b60-71c85f68b5f8 response_code = 200 uri = /v2p
27512024-12-21T02:58:52.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56863 req_id = c960b055-f322-47ed-a6ee-2eb14550e371 response_code = 204 uri = /vpc-routes
27522024-12-21T02:58:53.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35422
27532024-12-21T02:58:53.000ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27542024-12-21T02:58:53.038ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27552024-12-21T02:58:53.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93102 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35422 req_id = 88e41b96-aa28-4e84-a4d3-781db64bf2b1 response_code = 204 uri = /switch-ports
27562024-12-21T02:58:53.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35422 req_id = 2699d98e-440b-485e-a890-bbe20de69b9a response_code = 200 uri = /network-bootstore-config
27572024-12-21T02:59:04.028ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5838 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 16722a6e-a18c-4828-b5be-63c76d33843d response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27582024-12-21T02:59:19.938ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56261
27592024-12-21T02:59:19.938ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56261 req_id = e363f8e7-045d-4b2a-93cc-cfafebd62b4d response_code = 200 uri = /baseboard
27602024-12-21T02:59:22.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41922
27612024-12-21T02:59:22.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41922 req_id = 457a855f-9572-4097-9ffe-366ee592eaea response_code = 200 uri = /vpc-routes
27622024-12-21T02:59:22.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51043
27632024-12-21T02:59:22.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51043 req_id = ff713555-25aa-47db-befa-9f8636b79dab response_code = 200 uri = /v2p
27642024-12-21T02:59:22.214ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
27652024-12-21T02:59:22.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41922 req_id = 6467237e-a652-43f8-ac62-7aa0b5cea7c4 response_code = 204 uri = /eip-gateways
27662024-12-21T02:59:22.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41922 req_id = 4c11300f-6b61-44a1-b4a7-40f9a0f6369f response_code = 204 uri = /vpc-routes
27672024-12-21T02:59:22.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44164
27682024-12-21T02:59:22.223ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27692024-12-21T02:59:22.260ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27702024-12-21T02:59:22.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86906 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44164 req_id = 9c98e558-27fa-4f12-9d3d-4ae5fdc3149a response_code = 204 uri = /switch-ports
27712024-12-21T02:59:22.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44150
27722024-12-21T02:59:22.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40323
27732024-12-21T02:59:22.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44164 req_id = bcdc2209-b3c1-4325-9a6a-175c8a4563b9 response_code = 200 uri = /network-bootstore-config
27742024-12-21T02:59:22.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40323 req_id = 823aded7-213b-414a-87a4-c9b7e1b08a0e response_code = 200 uri = /vpc-routes
27752024-12-21T02:59:22.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44150 req_id = 4d1280bf-d88b-4ed8-8615-9f743e24a967 response_code = 200 uri = /v2p
27762024-12-21T02:59:22.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54545
27772024-12-21T02:59:22.330ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27782024-12-21T02:59:22.372ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27792024-12-21T02:59:22.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110402 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54545 req_id = aaa6c317-871b-4d21-805c-5f357a9bfca8 response_code = 204 uri = /switch-ports
27802024-12-21T02:59:22.441ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
27812024-12-21T02:59:22.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40323 req_id = fe156cd3-f681-4cf6-8094-62c8daba5691 response_code = 204 uri = /eip-gateways
27822024-12-21T02:59:22.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54545 req_id = 7ac4a9be-02b0-476c-921e-8f81738e0899 response_code = 200 uri = /network-bootstore-config
27832024-12-21T02:59:22.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40323 req_id = 24b10cae-97e3-43cd-85ed-a078f0c82111 response_code = 204 uri = /vpc-routes
27842024-12-21T02:59:22.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60533
27852024-12-21T02:59:22.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60533 req_id = f9d681cd-7834-4458-8535-e6238e501146 response_code = 200 uri = /vpc-routes
27862024-12-21T02:59:22.758ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
27872024-12-21T02:59:22.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60533 req_id = ff146bb7-7298-4738-b689-5a61b9b5e94d response_code = 204 uri = /eip-gateways
27882024-12-21T02:59:22.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60533 req_id = c1aef0cb-0041-4869-96c1-6a08a1635e03 response_code = 204 uri = /vpc-routes
27892024-12-21T02:59:22.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42888
27902024-12-21T02:59:22.783ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27912024-12-21T02:59:22.823ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27922024-12-21T02:59:22.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96363 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42888 req_id = 24d546ed-4e51-4b61-bc42-961d22570ef7 response_code = 204 uri = /switch-ports
27932024-12-21T02:59:22.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56597
27942024-12-21T02:59:22.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56597 req_id = c0ac8d98-f85c-4cb6-8111-9dd7f462e89d response_code = 200 uri = /v2p
27952024-12-21T02:59:22.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42888 req_id = ff5bd093-b129-426f-b699-90716515213b response_code = 200 uri = /network-bootstore-config
27962024-12-21T02:59:34.029ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6632 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = e634ad31-f7a3-48b0-aec0-ca5e550d4492 response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
27972024-12-21T02:59:49.973ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60507
27982024-12-21T02:59:49.973ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60507 req_id = 06b02b98-e726-440a-b8fd-00268f8f3720 response_code = 200 uri = /baseboard
27992024-12-21T02:59:52.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45571
28002024-12-21T02:59:52.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45571 req_id = d57e76f2-c615-4e14-aca9-98817f2cbf33 response_code = 200 uri = /vpc-routes
28012024-12-21T02:59:52.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44915
28022024-12-21T02:59:52.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44915 req_id = d60480c0-21d9-4eb7-8217-6a64639af23a response_code = 200 uri = /vpc-routes
28032024-12-21T02:59:52.242ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
28042024-12-21T02:59:52.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45571 req_id = 90abe21c-981b-441f-a94d-7aa1a18e4f71 response_code = 204 uri = /eip-gateways
28052024-12-21T02:59:52.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45571 req_id = e5c9bb9e-3f8b-400e-8ce9-91169cdf58a2 response_code = 204 uri = /vpc-routes
28062024-12-21T02:59:52.306ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
28072024-12-21T02:59:52.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44915 req_id = f0359027-631d-4b3f-a2cc-7e7f1666c115 response_code = 204 uri = /eip-gateways
28082024-12-21T02:59:52.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44915 req_id = 60c0b3a2-d10f-41f7-8889-1c938d5da7e1 response_code = 204 uri = /vpc-routes
28092024-12-21T02:59:52.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33998
28102024-12-21T02:59:52.385ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28112024-12-21T02:59:52.439ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28122024-12-21T02:59:52.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148428 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33998 req_id = e8dc8eda-e84e-4064-8cec-a989825da70c response_code = 204 uri = /switch-ports
28132024-12-21T02:59:52.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36043
28142024-12-21T02:59:52.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42924
28152024-12-21T02:59:52.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46501
28162024-12-21T02:59:52.534ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28172024-12-21T02:59:52.534ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28182024-12-21T02:59:52.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46501 req_id = d2716b92-e09d-4270-bdf6-5cb155e7a636 response_code = 200 uri = /v2p
28192024-12-21T02:59:52.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 481 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33998 req_id = 5152b368-2366-4f69-ac8b-5d2dda941165 response_code = 200 uri = /network-bootstore-config
28202024-12-21T02:59:52.535ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28212024-12-21T02:59:52.535ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/omicron-zones.json file = common/src/ledger.rs:177
28222024-12-21T02:59:52.542ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/omicron-zones.json file = common/src/ledger.rs:177
28232024-12-21T02:59:52.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56004
28242024-12-21T02:59:52.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56004 req_id = 86693f76-d8e2-41db-a143-f67a3043fff2 response_code = 200 uri = /v2p
28252024-12-21T02:59:52.559ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28262024-12-21T02:59:52.559ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_80c94f92-4b7a-4dba-9905-839fe80ef014
28272024-12-21T02:59:52.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61911
28282024-12-21T02:59:52.569ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e6764d0d-89f4-4d8a-aa9a-63a6b6c44f9c, kind: Service { id: 82a0d97c-0396-4dff-a562-7bc3f12f4b4d }, name: Name("external-dns-82a0d97c-0396-4dff-a562-7bc3f12f4b4d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 117])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b4479d-d7bc-48c5-b3c2-7051533d16f5, kind: Service { id: 7d789b63-e234-471f-abd5-426e10c5c6e3 }, name: Name("external-dns-7d789b63-e234-471f-abd5-426e10c5c6e3"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 89])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 86470b3f-1b5e-4e63-bb28-a8ff8c9cee13, kind: Service { id: 4f50fa81-5371-4a88-a8b4-4e3726e451a5 }, name: Name("nexus-4f50fa81-5371-4a88-a8b4-4e3726e451a5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9382bc6b-4023-4b07-839c-d3afc84529d0, kind: Service { id: 5f52ac53-51c8-4771-9e69-2b7ae5f68b33 }, name: Name("nexus-5f52ac53-51c8-4771-9e69-2b7ae5f68b33"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 240])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6053b1c-903b-4570-b781-38175f6759a7, kind: Service { id: dcf56aa4-8d02-4872-82c4-3d769bb7bde8 }, name: Name("nexus-dcf56aa4-8d02-4872-82c4-3d769bb7bde8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28292024-12-21T02:59:52.569ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28302024-12-21T02:59:52.569ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28312024-12-21T02:59:52.569ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28322024-12-21T02:59:52.570ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28332024-12-21T02:59:52.570ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28342024-12-21T02:59:52.570ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28352024-12-21T02:59:52.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4870 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61911 req_id = b797da7a-26e0-41df-8553-e5bd3f875d61 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28362024-12-21T02:59:52.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54894
28372024-12-21T02:59:52.585ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28382024-12-21T02:59:52.590ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e6764d0d-89f4-4d8a-aa9a-63a6b6c44f9c, kind: Service { id: 82a0d97c-0396-4dff-a562-7bc3f12f4b4d }, name: Name("external-dns-82a0d97c-0396-4dff-a562-7bc3f12f4b4d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 117])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b4479d-d7bc-48c5-b3c2-7051533d16f5, kind: Service { id: 7d789b63-e234-471f-abd5-426e10c5c6e3 }, name: Name("external-dns-7d789b63-e234-471f-abd5-426e10c5c6e3"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 89])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 86470b3f-1b5e-4e63-bb28-a8ff8c9cee13, kind: Service { id: 4f50fa81-5371-4a88-a8b4-4e3726e451a5 }, name: Name("nexus-4f50fa81-5371-4a88-a8b4-4e3726e451a5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9382bc6b-4023-4b07-839c-d3afc84529d0, kind: Service { id: 5f52ac53-51c8-4771-9e69-2b7ae5f68b33 }, name: Name("nexus-5f52ac53-51c8-4771-9e69-2b7ae5f68b33"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 240])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6053b1c-903b-4570-b781-38175f6759a7, kind: Service { id: dcf56aa4-8d02-4872-82c4-3d769bb7bde8 }, name: Name("nexus-dcf56aa4-8d02-4872-82c4-3d769bb7bde8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28392024-12-21T02:59:52.590ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28402024-12-21T02:59:52.590ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28412024-12-21T02:59:52.590ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28422024-12-21T02:59:52.590ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28432024-12-21T02:59:52.590ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28442024-12-21T02:59:52.590ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28452024-12-21T02:59:52.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54894 req_id = 291f65fe-5eaa-40e4-a016-f9faabc0d0db response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28462024-12-21T02:59:52.594ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28472024-12-21T02:59:52.594ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9
28482024-12-21T02:59:52.618ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28492024-12-21T02:59:52.618ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0
28502024-12-21T02:59:52.642ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28512024-12-21T02:59:52.642ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a1307d86-524f-4687-99b5-553fb50f6ebe
28522024-12-21T02:59:52.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112943 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42924 req_id = caa77749-1bf8-4401-8bc4-f0120c656217 response_code = 204 uri = /switch-ports
28532024-12-21T02:59:52.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42924 req_id = 51ecbaf3-b60a-4ad0-b2d6-cd28d3a23652 response_code = 200 uri = /network-bootstore-config
28542024-12-21T02:59:52.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45545
28552024-12-21T02:59:52.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45545 req_id = 3f569897-8def-45fd-b3b1-e446bd33aa04 response_code = 200 uri = /vpc-routes
28562024-12-21T02:59:52.669ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28572024-12-21T02:59:52.669ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12
28582024-12-21T02:59:52.708ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28592024-12-21T02:59:52.708ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_98af376c-57d5-4d4e-8868-ff737627f482
28602024-12-21T02:59:52.733ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
28612024-12-21T02:59:52.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45545 req_id = 18bc409e-30ce-4aff-a1d5-ff19dbf89f13 response_code = 204 uri = /eip-gateways
28622024-12-21T02:59:52.738ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28632024-12-21T02:59:52.738ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_63c9df44-0622-415c-a697-efc3e7bc6c27
28642024-12-21T02:59:52.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45545 req_id = 8a2bd1dc-a05c-47ab-bcf2-eea8e7e191b2 response_code = 204 uri = /vpc-routes
28652024-12-21T02:59:52.771ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28662024-12-21T02:59:52.771ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81a0e2aa-7a9f-464b-aaff-78e01f8fe036
28672024-12-21T02:59:52.799ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28682024-12-21T02:59:52.799ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc
28692024-12-21T02:59:52.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278697 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36043 req_id = d7edb2a6-4262-43d5-a3d1-d597823e20fd response_code = 200 uri = /inventory
28702024-12-21T02:59:52.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62228
28712024-12-21T02:59:52.855ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28722024-12-21T02:59:52.855ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28732024-12-21T02:59:52.855ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/omicron-zones.json file = common/src/ledger.rs:177
28742024-12-21T02:59:52.855ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/omicron-zones.json file = common/src/ledger.rs:177
28752024-12-21T02:59:52.870ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28762024-12-21T02:59:52.870ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_80c94f92-4b7a-4dba-9905-839fe80ef014
28772024-12-21T02:59:52.897ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28782024-12-21T02:59:52.899ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9
28792024-12-21T02:59:52.924ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28802024-12-21T02:59:52.924ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0
28812024-12-21T02:59:52.948ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28822024-12-21T02:59:52.948ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a1307d86-524f-4687-99b5-553fb50f6ebe
28832024-12-21T02:59:52.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37430
28842024-12-21T02:59:52.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37430 req_id = e801abff-e987-4250-a6d0-3a05565d08f0 response_code = 200 uri = /v2p
28852024-12-21T02:59:52.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65103
28862024-12-21T02:59:52.960ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28872024-12-21T02:59:52.975ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28882024-12-21T02:59:52.976ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12
28892024-12-21T02:59:52.998ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28902024-12-21T02:59:53.003ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28912024-12-21T02:59:53.003ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_98af376c-57d5-4d4e-8868-ff737627f482
28922024-12-21T02:59:53.026ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28932024-12-21T02:59:53.026ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_63c9df44-0622-415c-a697-efc3e7bc6c27
28942024-12-21T02:59:53.056ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28952024-12-21T02:59:53.056ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81a0e2aa-7a9f-464b-aaff-78e01f8fe036
28962024-12-21T02:59:53.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105709 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65103 req_id = 00a02caa-c985-4849-a95b-dfe243395405 response_code = 204 uri = /switch-ports
28972024-12-21T02:59:53.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65103 req_id = 5716adb6-4693-4842-9622-b7cf940d7692 response_code = 200 uri = /network-bootstore-config
28982024-12-21T02:59:53.081ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28992024-12-21T02:59:53.081ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc
29002024-12-21T02:59:53.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240392 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62228 req_id = a06b7355-6b33-4db3-ac24-2cd0da6fdb65 response_code = 200 uri = /inventory
29012024-12-21T02:59:53.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57287
29022024-12-21T02:59:53.240ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e6764d0d-89f4-4d8a-aa9a-63a6b6c44f9c, kind: Service { id: 82a0d97c-0396-4dff-a562-7bc3f12f4b4d }, name: Name("external-dns-82a0d97c-0396-4dff-a562-7bc3f12f4b4d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 117])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7b4479d-d7bc-48c5-b3c2-7051533d16f5, kind: Service { id: 7d789b63-e234-471f-abd5-426e10c5c6e3 }, name: Name("external-dns-7d789b63-e234-471f-abd5-426e10c5c6e3"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 89])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 86470b3f-1b5e-4e63-bb28-a8ff8c9cee13, kind: Service { id: 4f50fa81-5371-4a88-a8b4-4e3726e451a5 }, name: Name("nexus-4f50fa81-5371-4a88-a8b4-4e3726e451a5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9382bc6b-4023-4b07-839c-d3afc84529d0, kind: Service { id: 5f52ac53-51c8-4771-9e69-2b7ae5f68b33 }, name: Name("nexus-5f52ac53-51c8-4771-9e69-2b7ae5f68b33"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 240])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e6053b1c-903b-4570-b781-38175f6759a7, kind: Service { id: dcf56aa4-8d02-4872-82c4-3d769bb7bde8 }, name: Name("nexus-dcf56aa4-8d02-4872-82c4-3d769bb7bde8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29032024-12-21T02:59:53.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
29042024-12-21T02:59:53.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29052024-12-21T02:59:53.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29062024-12-21T02:59:53.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29072024-12-21T02:59:53.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29082024-12-21T02:59:53.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29092024-12-21T02:59:53.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57287 req_id = 7b84db8a-b0f0-4304-93eb-63b461e3d88c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29102024-12-21T02:59:53.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38060
29112024-12-21T02:59:53.915ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29122024-12-21T02:59:53.915ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29132024-12-21T02:59:53.915ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/18b40981-00da-48f4-b7f2-620c208131bb/config/omicron-zones.json file = common/src/ledger.rs:177
29142024-12-21T02:59:53.916ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/config/omicron-zones.json file = common/src/ledger.rs:177
29152024-12-21T02:59:53.928ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 80c94f92-4b7a-4dba-9905-839fe80ef014 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29162024-12-21T02:59:53.928ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_80c94f92-4b7a-4dba-9905-839fe80ef014
29172024-12-21T02:59:53.951ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 89cb8b49-996b-4540-9008-cb5c70dfc4d9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29182024-12-21T02:59:53.951ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_89cb8b49-996b-4540-9008-cb5c70dfc4d9
29192024-12-21T02:59:53.972ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 74fb7ca7-c189-47c2-a76d-c538432fe1f0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29202024-12-21T02:59:53.972ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_74fb7ca7-c189-47c2-a76d-c538432fe1f0
29212024-12-21T02:59:53.992ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a1307d86-524f-4687-99b5-553fb50f6ebe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29222024-12-21T02:59:53.992ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_a1307d86-524f-4687-99b5-553fb50f6ebe
29232024-12-21T02:59:54.013ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cae4be-2aa4-46cb-b515-4b676301fb12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29242024-12-21T02:59:54.013ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f7cae4be-2aa4-46cb-b515-4b676301fb12
29252024-12-21T02:59:54.035ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 98af376c-57d5-4d4e-8868-ff737627f482 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29262024-12-21T02:59:54.035ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_98af376c-57d5-4d4e-8868-ff737627f482
29272024-12-21T02:59:54.055ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 63c9df44-0622-415c-a697-efc3e7bc6c27 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29282024-12-21T02:59:54.055ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_63c9df44-0622-415c-a697-efc3e7bc6c27
29292024-12-21T02:59:54.074ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81a0e2aa-7a9f-464b-aaff-78e01f8fe036 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29302024-12-21T02:59:54.074ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81a0e2aa-7a9f-464b-aaff-78e01f8fe036
29312024-12-21T02:59:54.094ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3dccbcf8-70cb-4bd3-b798-64a7f92511cc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29322024-12-21T02:59:54.094ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3dccbcf8-70cb-4bd3-b798-64a7f92511cc
29332024-12-21T02:59:54.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190615 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38060 req_id = 642087ed-f59b-4248-954a-1a916a8d57c6 response_code = 200 uri = /inventory
29342024-12-21T03:00:04.030ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6568 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 407be3d6-9881-4adc-8ed5-943a1eb6588f response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
29352024-12-21T03:00:20.008ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46038
29362024-12-21T03:00:20.008ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46038 req_id = 64c64c49-3933-4354-9924-6b7c41e5ceb5 response_code = 200 uri = /baseboard
29372024-12-21T03:00:22.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41502
29382024-12-21T03:00:22.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41502 req_id = 5e1387de-3f0b-451b-91fe-f0c675bef417 response_code = 200 uri = /vpc-routes
29392024-12-21T03:00:22.094ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
29402024-12-21T03:00:22.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41502 req_id = 3c6b4dfd-c523-44e9-a059-4df437c8763e response_code = 204 uri = /eip-gateways
29412024-12-21T03:00:22.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41502 req_id = e17a6c72-90be-49a2-afb8-49b8264b8859 response_code = 204 uri = /vpc-routes
29422024-12-21T03:00:22.112ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65515
29432024-12-21T03:00:22.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65515 req_id = 69c4c2a4-3c91-4743-a914-a7eba834101f response_code = 200 uri = /vpc-routes
29442024-12-21T03:00:22.130ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
29452024-12-21T03:00:22.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65515 req_id = 0b5e9e07-7f94-4fc3-abbf-f961e89ed3a1 response_code = 204 uri = /eip-gateways
29462024-12-21T03:00:22.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38629
29472024-12-21T03:00:22.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38629 req_id = c6063077-dcc4-43fb-a2fc-7da569398a0c response_code = 200 uri = /v2p
29482024-12-21T03:00:22.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65515 req_id = 88da905a-5045-47e1-996a-cb3659cfcb25 response_code = 204 uri = /vpc-routes
29492024-12-21T03:00:22.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36194
29502024-12-21T03:00:22.193ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29512024-12-21T03:00:22.232ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29522024-12-21T03:00:22.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95464 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36194 req_id = 64fc1dda-59dd-4bfc-90ef-812f5f9f3844 response_code = 204 uri = /switch-ports
29532024-12-21T03:00:22.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39733
29542024-12-21T03:00:22.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60776
29552024-12-21T03:00:22.289ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29562024-12-21T03:00:22.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3353 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36194 req_id = dce52dd2-1703-4560-8967-368985b60d88 response_code = 200 uri = /network-bootstore-config
29572024-12-21T03:00:22.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3581 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39733 req_id = 012d4e8d-d892-4eb9-a6ca-297bbf5a330e response_code = 200 uri = /v2p
29582024-12-21T03:00:22.323ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29592024-12-21T03:00:22.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84371 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60776 req_id = ec0bd503-2301-4334-aa2a-f62a064c5e3e response_code = 204 uri = /switch-ports
29602024-12-21T03:00:22.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60776 req_id = f0b101a1-e9c7-44da-bf22-f064d0f5b282 response_code = 200 uri = /network-bootstore-config
29612024-12-21T03:00:22.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54799
29622024-12-21T03:00:22.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54799 req_id = 64fa7efd-28fd-497e-9887-283c4c3f2a72 response_code = 200 uri = /v2p
29632024-12-21T03:00:22.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62268
29642024-12-21T03:00:22.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62268 req_id = 5b8eae10-0d3b-41c1-8d8d-5aa70782b33a response_code = 200 uri = /vpc-routes
29652024-12-21T03:00:22.722ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
29662024-12-21T03:00:22.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62268 req_id = 3a76ef1c-b1cf-4b71-aa12-3d774bcff986 response_code = 204 uri = /eip-gateways
29672024-12-21T03:00:22.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62268 req_id = d4a3db4e-9433-4216-bdc7-d2e5d0c8fa05 response_code = 204 uri = /vpc-routes
29682024-12-21T03:00:22.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64221
29692024-12-21T03:00:22.751ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29702024-12-21T03:00:22.784ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29712024-12-21T03:00:22.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81007 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64221 req_id = ede7decf-4262-46dd-8b61-94529b1f2a03 response_code = 204 uri = /switch-ports
29722024-12-21T03:00:22.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64221 req_id = 621c4672-e090-4cea-87ef-d173d35bf571 response_code = 200 uri = /network-bootstore-config
29732024-12-21T03:00:34.028ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5344 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = c7ac8913-6c6a-47dd-a084-c5fb9cb4b01f response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
29742024-12-21T03:00:50.044ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65439
29752024-12-21T03:00:50.044ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65439 req_id = ec722964-a790-4c55-b845-5f2b79fb2670 response_code = 200 uri = /baseboard
29762024-12-21T03:00:52.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36644
29772024-12-21T03:00:52.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36644 req_id = ebd1939b-2070-4d40-b75c-a0bb3c6339f6 response_code = 200 uri = /vpc-routes
29782024-12-21T03:00:52.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46303
29792024-12-21T03:00:52.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46303 req_id = a04bc5bb-4c42-41a9-ac2d-5c3aa15ada30 response_code = 200 uri = /vpc-routes
29802024-12-21T03:00:52.264ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
29812024-12-21T03:00:52.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46303 req_id = e792914a-109e-4fe1-8482-e27f69746cd1 response_code = 204 uri = /eip-gateways
29822024-12-21T03:00:52.271ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
29832024-12-21T03:00:52.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36644 req_id = 12e93354-d2b9-4aaf-ac43-0bff4dc9d6bb response_code = 204 uri = /eip-gateways
29842024-12-21T03:00:52.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46303 req_id = 4fd7977c-3c27-4cb4-8c50-fe3c527f177b response_code = 204 uri = /vpc-routes
29852024-12-21T03:00:52.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36644 req_id = ee223bd7-b6da-498c-b76c-feffc4f0da97 response_code = 204 uri = /vpc-routes
29862024-12-21T03:00:52.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48139
29872024-12-21T03:00:52.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48139 req_id = d012853c-fa97-41c0-861b-af58279dbc6c response_code = 200 uri = /v2p
29882024-12-21T03:00:52.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39589
29892024-12-21T03:00:52.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39589 req_id = 28ebe595-8958-43a6-b32f-b61c73fd6218 response_code = 200 uri = /v2p
29902024-12-21T03:00:52.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39337
29912024-12-21T03:00:52.571ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29922024-12-21T03:00:52.612ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29932024-12-21T03:00:52.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94569 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39337 req_id = 6b6aa016-afad-46cc-bedb-0f490228ebdf response_code = 204 uri = /switch-ports
29942024-12-21T03:00:52.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64285
29952024-12-21T03:00:52.666ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29962024-12-21T03:00:52.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39337 req_id = 37abe50b-8801-4cc8-9970-e131d2a1c91b response_code = 200 uri = /network-bootstore-config
29972024-12-21T03:00:52.699ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29982024-12-21T03:00:52.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39285
29992024-12-21T03:00:52.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39285 req_id = 3d6c4163-38a0-4001-80a9-69ef32c5dbf7 response_code = 200 uri = /vpc-routes
30002024-12-21T03:00:52.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85982 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64285 req_id = 6dbec67f-43eb-492f-bc4e-92924734fddf response_code = 204 uri = /switch-ports
30012024-12-21T03:00:52.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64285 req_id = f8d0a3e0-2191-4060-a580-70515ccc64ff response_code = 200 uri = /network-bootstore-config
30022024-12-21T03:00:52.764ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
30032024-12-21T03:00:52.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39285 req_id = 93bdce29-72b4-44d9-9412-8f826f8191f4 response_code = 204 uri = /eip-gateways
30042024-12-21T03:00:52.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39285 req_id = 09f1e01f-6875-427a-a544-1a6ffa5c9a23 response_code = 204 uri = /vpc-routes
30052024-12-21T03:00:52.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42125
30062024-12-21T03:00:52.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42125 req_id = dddc6cc1-cc23-467c-a06e-18771982a6d5 response_code = 200 uri = /v2p
30072024-12-21T03:00:52.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53908
30082024-12-21T03:00:52.991ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
30092024-12-21T03:00:53.029ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
30102024-12-21T03:00:53.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91879 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53908 req_id = 62c28642-5220-438c-82db-6d78ae7800d7 response_code = 204 uri = /switch-ports
30112024-12-21T03:00:53.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53908 req_id = 6cfb3a1d-5015-4a7c-a939-86196d1873a2 response_code = 200 uri = /network-bootstore-config
30122024-12-21T03:01:04.031ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6147 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = bace5cb2-90a1-4311-af73-5f7bf88e41fa response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
30132024-12-21T03:01:09.036ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
30142024-12-21T03:01:20.079ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60362
30152024-12-21T03:01:20.079ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60362 req_id = 5767d287-391e-4053-ba97-a14e86e6dce2 response_code = 200 uri = /baseboard
30162024-12-21T03:01:22.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57137
30172024-12-21T03:01:22.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57137 req_id = 75e45307-7cad-46a0-8434-9561f46e2eaa response_code = 200 uri = /vpc-routes
30182024-12-21T03:01:22.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53053
30192024-12-21T03:01:22.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53053 req_id = 8033e2a1-516b-4e79-a47c-56d4b97cb474 response_code = 200 uri = /vpc-routes
30202024-12-21T03:01:22.188ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
30212024-12-21T03:01:22.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57137 req_id = c5b0f829-14e6-4666-b92d-b901ff24f0e1 response_code = 204 uri = /eip-gateways
30222024-12-21T03:01:22.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48838
30232024-12-21T03:01:22.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48838 req_id = 2c4430b5-9514-451f-a245-7bb6cb836d41 response_code = 200 uri = /v2p
30242024-12-21T03:01:22.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57137 req_id = 260cb4d5-9d42-42cd-8c4d-8d4eb79e3c9e response_code = 204 uri = /vpc-routes
30252024-12-21T03:01:22.227ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
30262024-12-21T03:01:22.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53053 req_id = deb2b28f-a037-4f8e-9bfc-2620a288bd7e response_code = 204 uri = /eip-gateways
30272024-12-21T03:01:22.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53053 req_id = 61d4863c-87e3-4a86-88ea-93cf3cf69b81 response_code = 204 uri = /vpc-routes
30282024-12-21T03:01:22.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64190
30292024-12-21T03:01:22.245ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
30302024-12-21T03:01:22.284ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
30312024-12-21T03:01:22.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93405 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64190 req_id = c0fb2582-1ec3-44b1-9058-31d4521ac6c2 response_code = 204 uri = /switch-ports
30322024-12-21T03:01:22.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51141
30332024-12-21T03:01:22.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35967
30342024-12-21T03:01:22.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35967 req_id = 9a116e68-0984-452e-9b1e-ef2bf946a659 response_code = 200 uri = /v2p
30352024-12-21T03:01:22.339ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
30362024-12-21T03:01:22.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64190 req_id = e2681c6e-2748-4294-85d1-38d682bc7e92 response_code = 200 uri = /network-bootstore-config
30372024-12-21T03:01:22.376ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
30382024-12-21T03:01:22.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112872 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51141 req_id = 343e8e73-aed4-48b8-b202-6850a602665b response_code = 204 uri = /switch-ports
30392024-12-21T03:01:22.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51141 req_id = 63e80ae8-6f32-4e93-8188-0fa596d9c025 response_code = 200 uri = /network-bootstore-config
30402024-12-21T03:01:22.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58316
30412024-12-21T03:01:22.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58316 req_id = 509153cb-9207-4bf4-be9a-d10369acb227 response_code = 200 uri = /vpc-routes
30422024-12-21T03:01:22.622ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
30432024-12-21T03:01:22.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58316 req_id = 14698785-2045-4452-ac02-5f74afc02eba response_code = 204 uri = /eip-gateways
30442024-12-21T03:01:22.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58316 req_id = 1060f321-03e1-466c-ad4c-57191234c40d response_code = 204 uri = /vpc-routes
30452024-12-21T03:01:22.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39030
30462024-12-21T03:01:22.706ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
30472024-12-21T03:01:22.744ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
30482024-12-21T03:01:22.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95963 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39030 req_id = 48e25ffe-8d3a-468e-8812-850f2fbd535d response_code = 204 uri = /switch-ports
30492024-12-21T03:01:22.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57125
30502024-12-21T03:01:22.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57125 req_id = 98130fda-e8db-4a9c-a400-1d0499d86980 response_code = 200 uri = /v2p
30512024-12-21T03:01:22.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39030 req_id = 17116b7c-93d6-41a0-a5a4-0711008fa912 response_code = 200 uri = /network-bootstore-config
30522024-12-21T03:01:34.031ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7283 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 6fc47dc5-4fb5-4654-8751-48b8e3ed612d response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
30532024-12-21T03:01:48.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36322
30542024-12-21T03:01:48.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36322 req_id = d9eee51e-9523-449d-a8b5-22766ec20334 response_code = 200 uri = /v2p
30552024-12-21T03:01:48.951ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(5175235) }
30562024-12-21T03:01:48.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36322 req_id = 470eaf4c-1cf6-4fce-abf3-23960f6a4d43 response_code = 204 uri = /v2p
30572024-12-21T03:01:49.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43704
30582024-12-21T03:01:49.090ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 5172f171-d114-4b2b-890e-c84f93efd72f, kind: Instance { id: f2add1f4-4e07-40dd-8c24-b64c4cfa91fc }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5175235), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5172f171-d114-4b2b-890e-c84f93efd72f, kind: Instance { id: f2add1f4-4e07-40dd-8c24-b64c4cfa91fc }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5175235), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5172f171-d114-4b2b-890e-c84f93efd72f, kind: Instance { id: f2add1f4-4e07-40dd-8c24-b64c4cfa91fc }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5175235), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(5175235))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5172f171-d114-4b2b-890e-c84f93efd72f, kind: Instance { id: f2add1f4-4e07-40dd-8c24-b64c4cfa91fc }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5175235), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-afa47af438a", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 419c22e2-c24d-4d47-b446-77c79aa9bd93, read_only_parent: Some(Volume { block_size: 512, id: 3ceebfb6-35ee-4fe2-91b1-67015380dcb7, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 53460364-1d2b-4b3f-b45c-f3544529926d, key: Some("puf1lG8J1yY/dipd2o3bBqGBl3e96+OvKTNmYog8rXo="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::18]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 419c22e2-c24d-4d47-b446-77c79aa9bd93, key: Some("GCUw8lBJp9bJzftSz6mazw6dhjKrFfgcivmuEu1zZxc="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19003", "[fd00:1122:3344:101::18]:19003", "[fd00:1122:3344:101::13]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-afa47af438a" }] }), cloud_init_bytes: Some(..) } instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc metadata = InstanceMetadata { silo_id: 871537f7-f2d9-43ea-807b-39a8eba23cc8, project_id: 7296de35-aa8c-45ba-9ca3-77ba0f00bdcd } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T03:01:49.083474222Z }
30592024-12-21T03:01:49.090ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc migration_id = None propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
30602024-12-21T03:01:49.091ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc migration_id = None propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 5172f171-d114-4b2b-890e-c84f93efd72f, kind: Instance { id: f2add1f4-4e07-40dd-8c24-b64c4cfa91fc }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5175235), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5172f171-d114-4b2b-890e-c84f93efd72f, kind: Instance { id: f2add1f4-4e07-40dd-8c24-b64c4cfa91fc }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5175235), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5172f171-d114-4b2b-890e-c84f93efd72f, kind: Instance { id: f2add1f4-4e07-40dd-8c24-b64c4cfa91fc }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5175235), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(5175235))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5172f171-d114-4b2b-890e-c84f93efd72f, kind: Instance { id: f2add1f4-4e07-40dd-8c24-b64c4cfa91fc }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5175235), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-afa47af438a", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 419c22e2-c24d-4d47-b446-77c79aa9bd93, read_only_parent: Some(Volume { block_size: 512, id: 3ceebfb6-35ee-4fe2-91b1-67015380dcb7, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 53460364-1d2b-4b3f-b45c-f3544529926d, key: Some("puf1lG8J1yY/dipd2o3bBqGBl3e96+OvKTNmYog8rXo="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::18]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 419c22e2-c24d-4d47-b446-77c79aa9bd93, key: Some("GCUw8lBJp9bJzftSz6mazw6dhjKrFfgcivmuEu1zZxc="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19003", "[fd00:1122:3344:101::18]:19003", "[fd00:1122:3344:101::13]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-afa47af438a" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T03:01:49.083474222Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
30612024-12-21T03:01:49.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9853 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43704 req_id = a8ed0e7a-5ada-4751-9675-1cef13a9d3c3 response_code = 200 uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
30622024-12-21T03:01:49.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40149
30632024-12-21T03:01:49.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 451 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40149 req_id = 323270c7-0c4c-40c1-b0e2-c57ba3ddcf71 response_code = 200 uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2/state
30642024-12-21T03:01:49.174ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 5175235 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
30652024-12-21T03:01:49.174ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30662024-12-21T03:01:49.213ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 file = illumos-utils/src/zone.rs:325 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
30672024-12-21T03:01:49.243ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 file = illumos-utils/src/zone.rs:363 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
30682024-12-21T03:01:49.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40903
30692024-12-21T03:01:49.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40903 req_id = e9821b22-2e9a-4193-af13-c1df73eb86c5 response_code = 200 uri = /vpc-routes
30702024-12-21T03:01:49.281ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {5172f171-d114-4b2b-890e-c84f93efd72f: {10.151.2.175: {430c7688-3300-43d1-9f47-aa431fc823c5}, 10.151.2.176: {430c7688-3300-43d1-9f47-aa431fc823c5}}} }
30712024-12-21T03:01:50.114ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36253
30722024-12-21T03:01:50.114ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36253 req_id = de05b25f-2300-4d24-8ee6-18778bab4955 response_code = 200 uri = /baseboard
30732024-12-21T03:01:50.601ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
30742024-12-21T03:01:50.601ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 zone file = illumos-utils/src/running_zone.rs:488 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 zone = oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
30752024-12-21T03:01:50.776ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2") failed: Property not found. retry in 66.840845ms file = illumos-utils/src/svc.rs:36 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 zone = oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
30762024-12-21T03:01:50.871ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2") failed: Property not found. retry in 112.162957ms file = illumos-utils/src/svc.rs:36 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 zone = oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
30772024-12-21T03:01:51.009ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2") failed: Property not found. retry in 260.480594ms file = illumos-utils/src/svc.rs:36 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 zone = oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
30782024-12-21T03:01:51.284ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2") failed: Property not found. retry in 489.532103ms file = illumos-utils/src/svc.rs:36 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 zone = oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
30792024-12-21T03:01:51.788ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2") failed: Property not found. retry in 988.32879ms file = illumos-utils/src/svc.rs:36 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 zone = oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
30802024-12-21T03:01:52.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43217
30812024-12-21T03:01:52.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41805
30822024-12-21T03:01:52.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61367
30832024-12-21T03:01:52.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61367 req_id = 4fb3787d-b2e7-47a1-87e8-52f92b4125ad response_code = 200 uri = /v2p
30842024-12-21T03:01:52.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49760
30852024-12-21T03:01:52.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49760 req_id = 495597c6-4e15-43a1-bfee-557bbf95b958 response_code = 200 uri = /vpc-routes
30862024-12-21T03:01:52.387ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {5172f171-d114-4b2b-890e-c84f93efd72f: {10.151.2.175: {430c7688-3300-43d1-9f47-aa431fc823c5}, 10.151.2.176: {430c7688-3300-43d1-9f47-aa431fc823c5}}} }
30872024-12-21T03:01:52.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49760 req_id = 60361547-b952-49ea-ae81-c1599239b596 response_code = 204 uri = /eip-gateways
30882024-12-21T03:01:52.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63573
30892024-12-21T03:01:52.423ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
30902024-12-21T03:01:52.488ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
30912024-12-21T03:01:52.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150134 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63573 req_id = c72be8e7-ea63-452b-ad02-123c96a688e8 response_code = 204 uri = /switch-ports
30922024-12-21T03:01:52.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34762
30932024-12-21T03:01:52.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50554
30942024-12-21T03:01:52.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 405 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63573 req_id = 5d132643-bac6-4f2d-92f8-da5ae506a44d response_code = 200 uri = /network-bootstore-config
30952024-12-21T03:01:52.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 705 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49760 req_id = 6bd0915e-3dc2-41bf-bf55-7e1133c43cd4 response_code = 204 uri = /vpc-routes
30962024-12-21T03:01:52.574ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
30972024-12-21T03:01:52.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 379 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50554 req_id = c40e0895-354b-4313-84e1-901ffc5ce97d response_code = 200 uri = /v2p
30982024-12-21T03:01:52.621ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
30992024-12-21T03:01:52.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120827 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34762 req_id = cfeaacbd-d1d8-4c63-b5ec-40345016930f response_code = 204 uri = /switch-ports
31002024-12-21T03:01:52.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34762 req_id = 32e2bab6-254f-4a3e-aa8a-a6bb96c62d04 response_code = 200 uri = /network-bootstore-config
31012024-12-21T03:01:52.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61586
31022024-12-21T03:01:52.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61586 req_id = 20bbbaff-13ed-409f-ba56-44e6c145e278 response_code = 200 uri = /vpc-routes
31032024-12-21T03:01:52.790ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2") failed: Property not found. retry in 1.366106002s file = illumos-utils/src/svc.rs:36 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 zone = oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31042024-12-21T03:01:52.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53894
31052024-12-21T03:01:52.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53894 req_id = b2280d1d-b7c7-4647-ab3b-882edb71bf71 response_code = 200 uri = /v2p
31062024-12-21T03:01:52.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63810
31072024-12-21T03:01:52.889ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {5172f171-d114-4b2b-890e-c84f93efd72f: {10.151.2.175: {430c7688-3300-43d1-9f47-aa431fc823c5}, 10.151.2.176: {430c7688-3300-43d1-9f47-aa431fc823c5}}} }
31082024-12-21T03:01:52.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61586 req_id = e3e73139-a4f1-404c-b81b-ca8978206a4a response_code = 204 uri = /eip-gateways
31092024-12-21T03:01:52.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61586 req_id = 14cca7d0-51f3-4f4f-8b13-57bfe69fe84f response_code = 204 uri = /vpc-routes
31102024-12-21T03:01:53.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35485
31112024-12-21T03:01:53.019ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
31122024-12-21T03:01:53.069ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
31132024-12-21T03:01:53.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126918 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35485 req_id = 2c9cdc12-5927-4c33-8cbf-06e692fdd593 response_code = 204 uri = /switch-ports
31142024-12-21T03:01:53.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35485 req_id = 89c434c6-48d4-4321-8901-aa94ba7e0302 response_code = 200 uri = /network-bootstore-config
31152024-12-21T03:01:54.169ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2") failed: Property not found. retry in 1.072479368s file = illumos-utils/src/svc.rs:36 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 zone = oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31162024-12-21T03:01:55.253ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2") failed: Property not found. retry in 984.538241ms file = illumos-utils/src/svc.rs:36 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 zone = oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31172024-12-21T03:01:56.267ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 file = sled-agent/src/instance.rs:1786 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31182024-12-21T03:01:56.275ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2") failed: Property not found. retry in 45.489472ms file = illumos-utils/src/svc.rs:36 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31192024-12-21T03:01:56.330ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2") failed: Property not found. retry in 67.394887ms file = illumos-utils/src/svc.rs:36 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31202024-12-21T03:01:56.408ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2") failed: Property not found. retry in 142.987419ms file = illumos-utils/src/svc.rs:36 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31212024-12-21T03:01:56.562ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31222024-12-21T03:01:56.600ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31232024-12-21T03:01:56.739ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31242024-12-21T03:01:56.741ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
31252024-12-21T03:01:56.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3873449 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63810 req_id = eb18d7e9-b973-40b9-8f93-2a99ed6f5fde response_code = 200 uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2/state
31262024-12-21T03:01:56.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4548870 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41805 req_id = b49268cc-b298-47ea-a787-83472590f02a response_code = 200 uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2/state
31272024-12-21T03:01:56.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4586494 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43217 req_id = 1035f758-94f8-49bf-b482-d91d37bd4ebc response_code = 200 uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2/state
31282024-12-21T03:01:56.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7460448 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40903 req_id = 436c8898-c96c-4a6d-b04c-2b0ad87de3df response_code = 204 uri = /eip-gateways
31292024-12-21T03:01:56.742ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-21T03:01:56.742690314Z } file = sled-agent/src/instance.rs:780 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31302024-12-21T03:01:56.742ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T03:01:56.742690314Z } propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31312024-12-21T03:01:56.742ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T03:01:56.742690314Z }, migration_in: None, migration_out: None }
31322024-12-21T03:01:56.792ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-21T03:01:56.792978221Z } file = sled-agent/src/instance.rs:780 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31332024-12-21T03:01:56.793ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T03:01:56.792978221Z } propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31342024-12-21T03:01:56.793ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T03:01:56.792978221Z }, migration_in: None, migration_out: None }
31352024-12-21T03:01:56.922ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 13a385fe-88b2-4d69-a957-fa8b739c2ea8, version: 3 } old_vers = RouterVersion { router_id: 13a385fe-88b2-4d69-a957-fa8b739c2ea8, version: 3 } subnet = RouterId { vni: Vni(5175235), kind: System }
31362024-12-21T03:01:56.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40903 req_id = 31a081da-1335-44b4-a836-fe5544a368c0 response_code = 204 uri = /vpc-routes
31372024-12-21T03:01:56.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46205
31382024-12-21T03:01:56.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46205 req_id = a66cae8d-63dd-4cf4-ae82-2017d4480819 response_code = 200 uri = /vpc-routes
31392024-12-21T03:01:56.980ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {5172f171-d114-4b2b-890e-c84f93efd72f: {10.151.2.175: {430c7688-3300-43d1-9f47-aa431fc823c5}, 10.151.2.176: {430c7688-3300-43d1-9f47-aa431fc823c5}}} }
31402024-12-21T03:01:56.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46205 req_id = 6c494bb0-661d-45ad-beb8-e0a75d7dec4f response_code = 204 uri = /eip-gateways
31412024-12-21T03:01:56.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46205 req_id = 07a30673-b7c1-4a51-8165-089cabcde6a4 response_code = 204 uri = /vpc-routes
31422024-12-21T03:02:04.031ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6703 local_addr = [fd00:1122:3344:101::1]:43662 method = GET remote_addr = [fd00:1122:3344:101::d]:58688 req_id = 860e563d-29e5-4541-9baa-9c8fa2b59803 response_code = 200 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 uri = /74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
31432024-12-21T03:02:06.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41192
31442024-12-21T03:02:06.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 528 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41192 req_id = 06c80f20-60a1-4b34-8a98-ecc022dd61e4 response_code = 200 uri = /vmms/b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2/state
31452024-12-21T03:02:06.728ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-21T03:02:06.728866351Z } file = sled-agent/src/instance.rs:780 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31462024-12-21T03:02:06.728ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T03:02:06.728866351Z } propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31472024-12-21T03:02:06.728ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T03:02:06.728866351Z }, migration_in: None, migration_out: None }
31482024-12-21T03:02:06.737ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopped), migration_in: None, migration_out: None, time: 2024-12-21T03:02:06.737417191Z } file = sled-agent/src/instance.rs:780 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31492024-12-21T03:02:06.737ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(7), time_updated: 2024-12-21T03:02:06.737417191Z } propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31502024-12-21T03:02:06.737ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(7), time_updated: 2024-12-21T03:02:06.737417191Z }, migration_in: None, migration_out: None }
31512024-12-21T03:02:06.805ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-21T03:02:06.805494466Z } file = sled-agent/src/instance.rs:780 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31522024-12-21T03:02:06.805ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T03:02:06.805494466Z } propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31532024-12-21T03:02:06.805ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31542024-12-21T03:02:06.805ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
31552024-12-21T03:02:06.805ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 12913827512882301634 n_samples = 6 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
31562024-12-21T03:02:06.805ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 10230451068775485491 n_samples = 6 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
31572024-12-21T03:02:06.805ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
31582024-12-21T03:02:06.805ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/18b40981-00da-48f4-b7f2-620c208131bb/debug/bundle/zone", "/pool/int/a5171080-2959-4ea4-a217-421d3a3b1186/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/80c94f92-4b7a-4dba-9905-839fe80ef014/crypt/debug", "/pool/ext/89cb8b49-996b-4540-9008-cb5c70dfc4d9/crypt/debug", "/pool/ext/74fb7ca7-c189-47c2-a76d-c538432fe1f0/crypt/debug", "/pool/ext/a1307d86-524f-4687-99b5-553fb50f6ebe/crypt/debug", "/pool/ext/f7cae4be-2aa4-46cb-b515-4b676301fb12/crypt/debug", "/pool/ext/98af376c-57d5-4d4e-8868-ff737627f482/crypt/debug", "/pool/ext/63c9df44-0622-415c-a697-efc3e7bc6c27/crypt/debug", "/pool/ext/81a0e2aa-7a9f-464b-aaff-78e01f8fe036/crypt/debug", "/pool/ext/3dccbcf8-70cb-4bd3-b798-64a7f92511cc/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31592024-12-21T03:02:07.451ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2", bundle_id: f2e06cc5-da5e-48cd-aec1-13bc24520ff1 }, time_created: 2024-12-21T03:02:06.806398487Z, version: 0, cause: TerminatedInstance }
31602024-12-21T03:02:07.451ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 file = sled-agent/src/instance.rs:1032 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31612024-12-21T03:02:09.230ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31622024-12-21T03:02:09.247ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(5175235), kind: System }
31632024-12-21T03:02:09.247ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(5175235), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
31642024-12-21T03:02:09.248ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-12-21T03:02:09.248327826Z }, migration_in: None, migration_out: None }
31652024-12-21T03:02:09.282ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-12-21T03:02:09.248327826Z }, migration_in: None, migration_out: None }
31662024-12-21T03:02:09.287ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = f2add1f4-4e07-40dd-8c24-b64c4cfa91fc propolis_id = b93c281e-5abb-46f0-9d6d-2c53e0c4b5a2
31672024-12-21T03:02:09.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50476
31682024-12-21T03:02:09.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50476 req_id = 1d721f36-99ca-4196-891a-168625306fe9 response_code = 200 uri = /vpc-routes
31692024-12-21T03:02:09.940ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
31702024-12-21T03:02:09.940ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531
31712024-12-21T03:02:09.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50476 req_id = 385c9fe7-9585-45a4-8d5e-ac63f8f40054 response_code = 204 uri = /eip-gateways
31722024-12-21T03:02:09.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33966
31732024-12-21T03:02:09.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33966 req_id = beb6baed-af14-4d8c-97b9-70dd20a175b2 response_code = 200 uri = /v2p
31742024-12-21T03:02:09.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50476 req_id = 2934d705-82e1-4431-9183-63ec04a08012 response_code = 204 uri = /vpc-routes
31752024-12-21T03:02:11.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41561
31762024-12-21T03:02:11.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41561 req_id = a7a88843-1732-489c-8ae9-332d8be9fdbc response_code = 200 uri = /v2p
31772024-12-21T03:02:11.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65517
31782024-12-21T03:02:11.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65517 req_id = 57ae9b09-fa4f-4c0e-8ce7-6b3dcc4a3fcc response_code = 200 uri = /vpc-routes
31792024-12-21T03:02:11.289ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
31802024-12-21T03:02:11.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65517 req_id = 13c77dbe-edfa-4dac-8cb5-83629cfe676f response_code = 204 uri = /eip-gateways
31812024-12-21T03:02:11.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65517 req_id = 072ccff4-157b-4a38-82bf-962cb8f176cc response_code = 204 uri = /vpc-routes
31822024-12-21T03:02:11.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39134
31832024-12-21T03:02:11.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39134 req_id = ccdee911-6ec9-4dca-973c-42d9132c9f79 response_code = 200 uri = /vpc-routes
31842024-12-21T03:02:11.977ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 74b11855-33fc-4fcf-8c0e-d7e8e9d5e531 values = ExternalIpGatewayMap { mappings: {} }
31852024-12-21T03:02:11.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39134 req_id = c4ac8876-2051-453c-8488-7c207b07ff0e response_code = 204 uri = /eip-gateways
31862024-12-21T03:02:11.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39134 req_id = bf7ede7e-9905-4459-9312-eda176cde69b response_code = 204 uri = /vpc-routes