Max level shown:
1 [ Nov 14 06:14:18 Enabled. ]
2 [ Nov 14 06:14:18 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 14 06:14:18 Method "start" exited with status 0. ]
4 [ Nov 14 06:14:18 Rereading configuration. ]
5 [ Nov 14 06:14:18 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-14T06:14:18.807ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-14T06:14:18.807ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-14T06:14:18.860ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-14T06:14:18.860ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-14T06:14:18.975ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-14T06:14:18.984ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-14T06:14:18.992ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-14T06:14:19.596ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-11-14T06:14:19.734ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-14T06:14:19.734ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-14T06:14:19.734ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-14T06:14:19.734ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-14T06:14:19.734ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-14T06:14:19.734ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-14T06:14:19.738ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-14T06:14:19.738ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-14T06:14:19.738ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-14T06:14:19.738ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-14T06:14:19.738ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-14T06:14:19.738ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-14T06:14:19.738ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-14T06:14:19.738ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-14T06:14:19.738ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-14T06:14:19.749ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-14T06:14:19.749ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 9689d903-825b-4779-be70-9f8994af1ce1 (zpool)
322024-11-14T06:14:19.859ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9689d903-825b-4779-be70-9f8994af1ce1 (zpool), kind: Internal }
332024-11-14T06:14:20.332ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-14T06:14:20.332ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-14T06:14:20.332ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-14T06:14:20.332ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-14T06:14:20.332ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-14T06:14:20.332ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-14T06:14:20.332ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-14T06:14:20.340ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-14T06:14:20.340ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 76f3af2c-fc04-48ec-bafb-5894ba33adee (zpool)
422024-11-14T06:14:20.430ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 76f3af2c-fc04-48ec-bafb-5894ba33adee (zpool), kind: Internal }
432024-11-14T06:14:20.900ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-14T06:14:20.900ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9689d903-825b-4779-be70-9f8994af1ce1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f3af2c-fc04-48ec-bafb-5894ba33adee (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-14T06:14:20.900ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
472024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482024-11-14T06:14:20.900ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-14T06:14:20.900ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-14T06:14:20.900ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9689d903-825b-4779-be70-9f8994af1ce1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f3af2c-fc04-48ec-bafb-5894ba33adee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-11-14T06:14:20.900ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
542024-11-14T06:14:20.900ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-11-14T06:14:20.900ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-14T06:14:20.900ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9689d903-825b-4779-be70-9f8994af1ce1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f3af2c-fc04-48ec-bafb-5894ba33adee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582024-11-14T06:14:20.900ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
592024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
602024-11-14T06:14:20.900ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-11-14T06:14:20.900ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-14T06:14:20.900ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9689d903-825b-4779-be70-9f8994af1ce1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f3af2c-fc04-48ec-bafb-5894ba33adee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-11-14T06:14:20.900ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
642024-11-14T06:14:20.900ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-11-14T06:14:20.900ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-14T06:14:20.900ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9689d903-825b-4779-be70-9f8994af1ce1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f3af2c-fc04-48ec-bafb-5894ba33adee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-14T06:14:20.900ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-11-14T06:14:20.900ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-14T06:14:20.900ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-14T06:14:20.900ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9689d903-825b-4779-be70-9f8994af1ce1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f3af2c-fc04-48ec-bafb-5894ba33adee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-14T06:14:20.900ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-11-14T06:14:20.900ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-14T06:14:20.900ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-14T06:14:20.900ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-11-14T06:14:20.900ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9689d903-825b-4779-be70-9f8994af1ce1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f3af2c-fc04-48ec-bafb-5894ba33adee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
822024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
832024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
842024-11-14T06:14:20.900ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-11-14T06:14:20.900ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-14T06:14:20.900ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-11-14T06:14:20.900ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-11-14T06:14:20.900ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9689d903-825b-4779-be70-9f8994af1ce1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f3af2c-fc04-48ec-bafb-5894ba33adee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-11-14T06:14:20.900ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-11-14T06:14:20.900ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9689d903-825b-4779-be70-9f8994af1ce1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f3af2c-fc04-48ec-bafb-5894ba33adee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
942024-11-14T06:14:20.900ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
952024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
962024-11-14T06:14:20.900ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972024-11-14T06:14:20.900ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-14T06:14:20.900ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-14T06:14:20.900ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9689d903-825b-4779-be70-9f8994af1ce1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f3af2c-fc04-48ec-bafb-5894ba33adee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-11-14T06:14:20.900ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-11-14T06:14:20.900ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-11-14T06:14:20.900ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-14T06:14:20.900ZINFOSledAgent (bootstore): No ledger in /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-11-14T06:14:20.900ZINFOSledAgent (bootstore): No ledger in /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-11-14T06:14:20.900ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-11-14T06:14:20.900ZINFOSledAgent (bootstore): No ledger in /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-11-14T06:14:20.900ZINFOSledAgent (bootstore): No ledger in /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-11-14T06:14:20.900ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-11-14T06:14:20.900ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-14T06:14:20.900ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-14T06:14:20.911ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-11-14T06:14:20.911ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1317, tv_nsec: 66615494 } time_to_next_cleanup = 599.999914738s
1142024-11-14T06:14:20.911ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-11-14T06:14:20.911ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-14T06:14:20.911ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-14T06:14:20.911ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-14T06:14:20.914ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-11-14T06:14:20.916ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-11-14T06:14:20.917ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1198
1212024-11-14T06:14:20.917ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-14T06:14:20.917ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-14T06:14:20.917ZINFOSledAgent (RSS): No ledger in /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-14T06:14:20.917ZINFOSledAgent (RSS): No ledger in /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-14T06:14:20.917ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1261
1262024-11-14T06:14:20.917ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-14T06:14:20.917ZINFOSledAgent (RSS): No ledger in /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-14T06:14:20.917ZINFOSledAgent (RSS): No ledger in /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-14T06:14:20.917ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1303
1302024-11-14T06:14:20.917ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-14T06:14:20.917ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-14T06:14:20.917ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-14T06:14:20.917ZINFOSledAgent (RSS): Writing ledger to /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-14T06:14:20.917ZINFOSledAgent (RSS): Writing ledger to /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-14T06:14:20.918ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, sleds: { [fdb0:18c0:4d0d:a02a::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d (sled), rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-14T06:14:20.918ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1337
1372024-11-14T06:14:20.918ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382024-11-14T06:14:20.918ZINFOSledAgent (bootstore): Writing ledger to /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1392024-11-14T06:14:20.918ZINFOSledAgent (bootstore): Writing ledger to /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-11-14T06:14:20.918ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412024-11-14T06:14:20.918ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d (sled), rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422024-11-14T06:14:20.918ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1432024-11-14T06:14:20.918ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1442024-11-14T06:14:20.923ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-14T06:14:20.929ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-14T06:14:20.929ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-14T06:14:20.933ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-14T06:14:20.933ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-14T06:14:20.933ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:60131
1502024-11-14T06:14:20.933ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d (sled), rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-14T06:14:20.933ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-14T06:14:20.933ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-14T06:14:20.933ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-14T06:14:20.933ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1552024-11-14T06:14:20.933ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1562024-11-14T06:14:20.934ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1572024-11-14T06:14:20.934ZINFOSledAgent (StorageManager): No ledger in /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-11-14T06:14:20.934ZINFOSledAgent (StorageManager): No ledger in /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-11-14T06:14:20.934ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1602024-11-14T06:14:20.934ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1612024-11-14T06:14:20.934ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1622024-11-14T06:14:20.934ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-14T06:14:20.934ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1642024-11-14T06:14:20.950ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1652024-11-14T06:14:20.970ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-14T06:14:20.983ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
1672024-11-14T06:14:20.983ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1682024-11-14T06:14:20.983ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
1692024-11-14T06:14:20.983ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1702024-11-14T06:14:20.986ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 88.970027ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "486f10dd-67d1-408f-b697-3965e3d707bd", "content-length": "124", "date": "Thu, 14 Nov 2024 06:14:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "486f10dd-67d1-408f-b697-3965e3d707bd" } file = clients/ddm-admin-client/src/lib.rs:177
1712024-11-14T06:14:20.987ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1722024-11-14T06:14:20.996ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_9689d903-825b-4779-be70-9f8994af1ce1/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-14T06:14:21.020ZINFOSledAgent: successfully created encrypted zvol: name="oxi_9689d903-825b-4779-be70-9f8994af1ce1/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-14T06:14:21.020ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_9689d903-825b-4779-be70-9f8994af1ce1/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-14T06:14:21.025ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
1762024-11-14T06:14:21.025ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-14T06:14:21.025ZINFOSledAgent (BackingFs): Ensuring dataset oxi_9689d903-825b-4779-be70-9f8994af1ce1/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-14T06:14:21.076ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-11-14T06:14:21.077ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 108.477177ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "13e1b63d-a443-4796-a050-0ff8420a6488", "content-length": "124", "date": "Thu, 14 Nov 2024 06:14:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "13e1b63d-a443-4796-a050-0ff8420a6488" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-11-14T06:14:21.111ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1812024-11-14T06:14:21.186ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-14T06:14:21.187ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 130.699532ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6543d68d-60d2-43b2-9e9c-ec1366a908fc", "content-length": "124", "date": "Thu, 14 Nov 2024 06:14:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6543d68d-60d2-43b2-9e9c-ec1366a908fc" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-14T06:14:21.318ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1842024-11-14T06:14:21.318ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 186.420765ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ef7f302f-900b-4d4c-8d6f-08faf8c48cf5", "content-length": "124", "date": "Thu, 14 Nov 2024 06:14:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ef7f302f-900b-4d4c-8d6f-08faf8c48cf5" } file = clients/ddm-admin-client/src/lib.rs:177
1852024-11-14T06:14:21.330ZINFOSledAgent (BackingFs): Mounting oxi_9689d903-825b-4779-be70-9f8994af1ce1/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1862024-11-14T06:14:21.342ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1872024-11-14T06:14:21.342ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1882024-11-14T06:14:21.342ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1892024-11-14T06:14:21.342ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1902024-11-14T06:14:21.506ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-14T06:14:21.507ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 251.887194ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4aa9a2f5-16bb-4365-b038-66d6ef856c82", "content-length": "124", "date": "Thu, 14 Nov 2024 06:14:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4aa9a2f5-16bb-4365-b038-66d6ef856c82" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-14T06:14:21.759ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-14T06:14:21.760ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 337.87323ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e7f3205e-12dd-478d-8161-772c76f80b20", "content-length": "124", "date": "Thu, 14 Nov 2024 06:14:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e7f3205e-12dd-478d-8161-772c76f80b20" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-14T06:14:22.070ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
1952024-11-14T06:14:22.076ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:64078 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
1962024-11-14T06:14:22.076ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
1972024-11-14T06:14:22.076ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:64078 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
1982024-11-14T06:14:22.077ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 323.258574ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
1992024-11-14T06:14:22.078ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
2002024-11-14T06:14:22.078ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
2012024-11-14T06:14:22.078ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2022024-11-14T06:14:22.078ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032024-11-14T06:14:22.100ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042024-11-14T06:14:22.402ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 391.633683ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
2052024-11-14T06:14:22.794ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.499326629s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
2062024-11-14T06:14:24.296ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.226568069s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
2072024-11-14T06:14:24.596ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2082024-11-14T06:14:24.596ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2092024-11-14T06:14:24.596ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2102024-11-14T06:14:24.596ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2112024-11-14T06:14:24.596ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2122024-11-14T06:14:24.596ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2132024-11-14T06:14:24.598ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2142024-11-14T06:14:24.599ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2152024-11-14T06:14:24.599ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='07d948d3-6a47-45eb-9ed3-629b45d23b8a'/> <propval type="astring" name="rack_id" value='f391bffc-9f2b-4c87-85cd-2718afa7cb93'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fea1:7110'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='f391bffc-9f2b-4c87-85cd-2718afa7cb93'/> <propval type="astring" name="sled_id" value='27a56cb4-44ff-4d5b-931e-1c2c0642844d'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='27a56cb4-44ff-4d5b-931e-1c2c0642844d'/> <propval type="astring" name="rack_uuid" value='f391bffc-9f2b-4c87-85cd-2718afa7cb93'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='27a56cb4-44ff-4d5b-931e-1c2c0642844d'/> <propval type="astring" name="rack_uuid" value='f391bffc-9f2b-4c87-85cd-2718afa7cb93'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162024-11-14T06:14:24.600ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172024-11-14T06:14:24.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 68.175977ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-11-14T06:14:25.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 83.604088ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-11-14T06:14:25.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 147.411998ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-11-14T06:14:25.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 236.824098ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-14T06:14:25.524ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.235816681s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
2222024-11-14T06:14:25.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 600.171023ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-14T06:14:26.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 680.134514ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-14T06:14:27.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.016338188s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-14T06:14:28.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.179250605s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-14T06:14:29.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.494241622s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-14T06:14:30.762ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.23625155s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
2282024-11-14T06:14:31.599ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/27a56cb4-44ff-4d5b-931e-1c2c0642844d) file = sled-agent/src/nexus.rs:527 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
2292024-11-14T06:14:31.629ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2302024-11-14T06:14:31.629ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
2312024-11-14T06:14:31.630ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2322024-11-14T06:14:31.630ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2332024-11-14T06:14:31.630ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2342024-11-14T06:14:31.630ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352024-11-14T06:14:31.630ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362024-11-14T06:14:31.630ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2372024-11-14T06:14:31.631ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2382024-11-14T06:14:31.631ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2392024-11-14T06:14:31.631ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:60131
2402024-11-14T06:14:31.811ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2412024-11-14T06:14:31.811ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2422024-11-14T06:14:31.811ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2432024-11-14T06:14:31.811ZINFOSledAgent (RSS): No ledger in /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2442024-11-14T06:14:31.811ZINFOSledAgent (RSS): No ledger in /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2452024-11-14T06:14:31.811ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2462024-11-14T06:14:31.811ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2472024-11-14T06:14:31.811ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2482024-11-14T06:14:31.811ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2492024-11-14T06:14:31.816ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2502024-11-14T06:14:31.816ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2512024-11-14T06:14:31.816ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2522024-11-14T06:14:32.081ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
2532024-11-14T06:14:32.081ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
2542024-11-14T06:14:32.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35286
2552024-11-14T06:14:32.087ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2562024-11-14T06:14:32.087ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2572024-11-14T06:14:32.087ZINFOSledAgent (ServiceManager): No ledger in /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/omicron-zones.json file = common/src/ledger.rs:188
2582024-11-14T06:14:32.087ZINFOSledAgent (ServiceManager): No ledger in /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/omicron-zones.json file = common/src/ledger.rs:188
2592024-11-14T06:14:32.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35286 req_id = 31d4afee-b034-4de7-9601-8acda1ae5fb1 response_code = 200 uri = /inventory
2602024-11-14T06:14:32.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41471
2612024-11-14T06:14:32.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41471 req_id = 0696c4f2-84c7-4811-bfbf-a8e30e49655b response_code = 200 uri = /sled-role
2622024-11-14T06:14:32.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2632024-11-14T06:14:32.117ZINFOSledAgent (RSS): Writing ledger to /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2642024-11-14T06:14:32.118ZINFOSledAgent (RSS): Writing ledger to /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2652024-11-14T06:14:32.118ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2662024-11-14T06:14:32.147ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 7200f878-0b79-471d-943f-a7456d03aa99, pool_id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 0f7078ab-9534-479e-97fb-5d92aff23217, pool_id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: ac70c917-7338-46fc-bc5a-31bb62e95641, pool_id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 675d4e3a-cf28-4692-8edd-d4264488bce5, pool_id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c937aad7-4c5e-4cda-b007-5e8d662d1096, pool_id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 0ad7d472-4fd4-4059-9d34-8b341fa41001, pool_id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: d3855842-9941-4424-bd49-80c7a63994d6, pool_id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 461c345f-3598-428d-a0e1-53e361701236, pool_id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 0f1d1d8b-804f-4d02-b11c-e2a17c07020a, pool_id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2672024-11-14T06:14:32.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41881
2682024-11-14T06:14:32.147ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:884 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
2692024-11-14T06:14:32.147ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 7200f878-0b79-471d-943f-a7456d03aa99, pool_id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 0f7078ab-9534-479e-97fb-5d92aff23217, pool_id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: ac70c917-7338-46fc-bc5a-31bb62e95641, pool_id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 675d4e3a-cf28-4692-8edd-d4264488bce5, pool_id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c937aad7-4c5e-4cda-b007-5e8d662d1096, pool_id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 0ad7d472-4fd4-4059-9d34-8b341fa41001, pool_id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: d3855842-9941-4424-bd49-80c7a63994d6, pool_id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 461c345f-3598-428d-a0e1-53e361701236, pool_id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 0f1d1d8b-804f-4d02-b11c-e2a17c07020a, pool_id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2702024-11-14T06:14:32.147ZINFOSledAgent (StorageManager): No ledger in /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2712024-11-14T06:14:32.147ZINFOSledAgent (StorageManager): No ledger in /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2722024-11-14T06:14:32.147ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2732024-11-14T06:14:32.147ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2742024-11-14T06:14:32.147ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2752024-11-14T06:14:32.147ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2762024-11-14T06:14:32.147ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2772024-11-14T06:14:32.278ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
2782024-11-14T06:14:32.285ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2792024-11-14T06:14:32.285ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3687329d-db08-4cdf-99f1-652e017f6592 (zpool)
2802024-11-14T06:14:32.381ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }
2812024-11-14T06:14:32.389ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2822024-11-14T06:14:32.389ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2832024-11-14T06:14:32.389ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2842024-11-14T06:14:32.389ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2852024-11-14T06:14:32.389ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2862024-11-14T06:14:32.389ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2872024-11-14T06:14:32.389ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2882024-11-14T06:14:32.424ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2892024-11-14T06:14:32.432ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3687329d-db08-4cdf-99f1-652e017f6592/crypt/zone file = sled-storage/src/dataset.rs:303
2902024-11-14T06:14:32.601ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3687329d-db08-4cdf-99f1-652e017f6592 file = sled-storage/src/dataset.rs:389
2912024-11-14T06:14:32.609ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2922024-11-14T06:14:32.609ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2932024-11-14T06:14:32.609ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2942024-11-14T06:14:32.609ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2952024-11-14T06:14:32.609ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2962024-11-14T06:14:32.619ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2972024-11-14T06:14:32.619ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool)
2982024-11-14T06:14:32.712ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }
2992024-11-14T06:14:32.720ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3002024-11-14T06:14:32.720ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3012024-11-14T06:14:32.720ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3022024-11-14T06:14:32.720ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3032024-11-14T06:14:32.720ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3042024-11-14T06:14:32.720ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3052024-11-14T06:14:32.720ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3062024-11-14T06:14:32.756ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3072024-11-14T06:14:32.760ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d) file = sled-agent/src/probe_manager.rs:231 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
3082024-11-14T06:14:32.764ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/zone file = sled-storage/src/dataset.rs:303
3092024-11-14T06:14:32.931ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3 file = sled-storage/src/dataset.rs:389
3102024-11-14T06:14:32.939ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3112024-11-14T06:14:32.939ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3122024-11-14T06:14:32.939ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3132024-11-14T06:14:32.939ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3142024-11-14T06:14:32.939ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3152024-11-14T06:14:32.948ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3162024-11-14T06:14:32.948ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool)
3172024-11-14T06:14:33.041ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }
3182024-11-14T06:14:33.049ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3192024-11-14T06:14:33.049ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3202024-11-14T06:14:33.049ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3212024-11-14T06:14:33.049ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3222024-11-14T06:14:33.049ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3232024-11-14T06:14:33.049ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3242024-11-14T06:14:33.049ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3252024-11-14T06:14:33.084ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3262024-11-14T06:14:33.092ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crypt/zone file = sled-storage/src/dataset.rs:303
3272024-11-14T06:14:33.258ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae file = sled-storage/src/dataset.rs:389
3282024-11-14T06:14:33.266ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3292024-11-14T06:14:33.266ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3302024-11-14T06:14:33.266ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3312024-11-14T06:14:33.266ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3322024-11-14T06:14:33.266ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3332024-11-14T06:14:33.276ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3342024-11-14T06:14:33.276ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool)
3352024-11-14T06:14:33.369ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }
3362024-11-14T06:14:33.377ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3372024-11-14T06:14:33.377ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3382024-11-14T06:14:33.377ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3392024-11-14T06:14:33.377ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3402024-11-14T06:14:33.377ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3412024-11-14T06:14:33.377ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3422024-11-14T06:14:33.377ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3432024-11-14T06:14:33.414ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3442024-11-14T06:14:33.421ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73/crypt/zone file = sled-storage/src/dataset.rs:303
3452024-11-14T06:14:33.589ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 file = sled-storage/src/dataset.rs:389
3462024-11-14T06:14:33.597ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3472024-11-14T06:14:33.597ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3482024-11-14T06:14:33.597ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3492024-11-14T06:14:33.597ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3502024-11-14T06:14:33.597ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3512024-11-14T06:14:33.606ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3522024-11-14T06:14:33.606ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool)
3532024-11-14T06:14:33.700ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }
3542024-11-14T06:14:33.707ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3552024-11-14T06:14:33.707ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3562024-11-14T06:14:33.707ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3572024-11-14T06:14:33.707ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3582024-11-14T06:14:33.707ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3592024-11-14T06:14:33.708ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3602024-11-14T06:14:33.708ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3612024-11-14T06:14:33.741ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3622024-11-14T06:14:33.748ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374/crypt/zone file = sled-storage/src/dataset.rs:303
3632024-11-14T06:14:33.761ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d) file = sled-agent/src/probe_manager.rs:231 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
3642024-11-14T06:14:33.919ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 file = sled-storage/src/dataset.rs:389
3652024-11-14T06:14:33.927ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3662024-11-14T06:14:33.927ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3672024-11-14T06:14:33.927ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3682024-11-14T06:14:33.927ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3692024-11-14T06:14:33.927ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3702024-11-14T06:14:33.936ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3712024-11-14T06:14:33.936ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool)
3722024-11-14T06:14:34.030ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }
3732024-11-14T06:14:34.038ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3742024-11-14T06:14:34.038ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3752024-11-14T06:14:34.038ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3762024-11-14T06:14:34.038ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3772024-11-14T06:14:34.038ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3782024-11-14T06:14:34.038ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3792024-11-14T06:14:34.038ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3802024-11-14T06:14:34.071ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3812024-11-14T06:14:34.078ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4ce86c2f-d73a-421e-8735-58bc8979e498/crypt/zone file = sled-storage/src/dataset.rs:303
3822024-11-14T06:14:34.247ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4ce86c2f-d73a-421e-8735-58bc8979e498 file = sled-storage/src/dataset.rs:389
3832024-11-14T06:14:34.255ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3842024-11-14T06:14:34.255ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3852024-11-14T06:14:34.255ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3862024-11-14T06:14:34.255ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3872024-11-14T06:14:34.255ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3882024-11-14T06:14:34.264ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3892024-11-14T06:14:34.264ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool)
3902024-11-14T06:14:34.366ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }
3912024-11-14T06:14:34.373ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3922024-11-14T06:14:34.373ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3932024-11-14T06:14:34.373ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3942024-11-14T06:14:34.373ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3952024-11-14T06:14:34.373ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3962024-11-14T06:14:34.373ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3972024-11-14T06:14:34.373ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3982024-11-14T06:14:34.408ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3992024-11-14T06:14:34.416ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_93a2b028-0235-4af9-913d-cd3caeb886d5/crypt/zone file = sled-storage/src/dataset.rs:303
4002024-11-14T06:14:34.589ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_93a2b028-0235-4af9-913d-cd3caeb886d5 file = sled-storage/src/dataset.rs:389
4012024-11-14T06:14:34.598ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4022024-11-14T06:14:34.598ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4032024-11-14T06:14:34.598ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4042024-11-14T06:14:34.598ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4052024-11-14T06:14:34.598ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4062024-11-14T06:14:34.607ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4072024-11-14T06:14:34.607ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool)
4082024-11-14T06:14:34.701ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }
4092024-11-14T06:14:34.709ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4102024-11-14T06:14:34.709ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4112024-11-14T06:14:34.709ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4122024-11-14T06:14:34.709ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4132024-11-14T06:14:34.709ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4142024-11-14T06:14:34.709ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4152024-11-14T06:14:34.709ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4162024-11-14T06:14:34.745ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4172024-11-14T06:14:34.753ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_195bff2e-21e5-469e-88de-7266b55e8b12/crypt/zone file = sled-storage/src/dataset.rs:303
4182024-11-14T06:14:34.764ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d) file = sled-agent/src/probe_manager.rs:231 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
4192024-11-14T06:14:34.941ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_195bff2e-21e5-469e-88de-7266b55e8b12 file = sled-storage/src/dataset.rs:389
4202024-11-14T06:14:34.948ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4212024-11-14T06:14:34.948ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4222024-11-14T06:14:34.948ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4232024-11-14T06:14:34.948ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4242024-11-14T06:14:34.948ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4252024-11-14T06:14:34.958ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4262024-11-14T06:14:34.958ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool)
4272024-11-14T06:14:35.055ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }
4282024-11-14T06:14:35.063ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4292024-11-14T06:14:35.063ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4302024-11-14T06:14:35.063ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4312024-11-14T06:14:35.063ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4322024-11-14T06:14:35.063ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4332024-11-14T06:14:35.063ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4342024-11-14T06:14:35.063ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4352024-11-14T06:14:35.097ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4362024-11-14T06:14:35.105ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f/crypt/zone file = sled-storage/src/dataset.rs:303
4372024-11-14T06:14:35.277ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f file = sled-storage/src/dataset.rs:389
4382024-11-14T06:14:35.285ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4392024-11-14T06:14:35.285ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4402024-11-14T06:14:35.285ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4412024-11-14T06:14:35.285ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9689d903-825b-4779-be70-9f8994af1ce1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76f3af2c-fc04-48ec-bafb-5894ba33adee (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4422024-11-14T06:14:35.285ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4432024-11-14T06:14:35.285ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4442024-11-14T06:14:35.285ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4452024-11-14T06:14:35.285ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:888 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
4462024-11-14T06:14:35.285ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4472024-11-14T06:14:35.285ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:914 generation = Generation(1) sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
4482024-11-14T06:14:35.285ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:919 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
4492024-11-14T06:14:35.285ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:924 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
4502024-11-14T06:14:35.285ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
4512024-11-14T06:14:35.286ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:930 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
4522024-11-14T06:14:35.286ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4532024-11-14T06:14:35.286ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:935 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
4542024-11-14T06:14:35.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3138550 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41881 req_id = f5fc6ee3-862f-465c-80d6-4bc869ec9eee response_code = 200 uri = /omicron-physical-disks
4552024-11-14T06:14:35.317ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0246f324-f80e-444b-98ed-abffe5a5bd9e (dataset): DatasetConfig { id: 0246f324-f80e-444b-98ed-abffe5a5bd9e (dataset), name: DatasetName { pool_name: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 03f31b63-1801-4e24-9d06-85cc54499a00 (dataset): DatasetConfig { id: 03f31b63-1801-4e24-9d06-85cc54499a00 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 046e9198-af0d-41b0-9419-9ecbe038328e (dataset): DatasetConfig { id: 046e9198-af0d-41b0-9419-9ecbe038328e (dataset), name: DatasetName { pool_name: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 09182161-cb48-4151-a340-a280be1f91df (dataset): DatasetConfig { id: 09182161-cb48-4151-a340-a280be1f91df (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 09f7b43d-eec9-425f-a4de-9d41c2860382 (dataset): DatasetConfig { id: 09f7b43d-eec9-425f-a4de-9d41c2860382 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e8fd62c-af02-414e-baa7-1a543a2854bf (dataset): DatasetConfig { id: 0e8fd62c-af02-414e-baa7-1a543a2854bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 15c9cdc9-3ae6-47a0-8248-60ec864965a1 (dataset): DatasetConfig { id: 15c9cdc9-3ae6-47a0-8248-60ec864965a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19078117-c104-4216-992b-fe30db9cf97c (dataset): DatasetConfig { id: 19078117-c104-4216-992b-fe30db9cf97c (dataset), name: DatasetName { pool_name: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1911efab-b77b-4875-a032-9db03556b64b (dataset): DatasetConfig { id: 1911efab-b77b-4875-a032-9db03556b64b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1dd9f849-1889-476a-ac01-966d390dea4e (dataset): DatasetConfig { id: 1dd9f849-1889-476a-ac01-966d390dea4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 208104fa-3818-4224-90f4-db281a67e60f (dataset): DatasetConfig { id: 208104fa-3818-4224-90f4-db281a67e60f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20e2e7d1-97d3-4a1c-8317-b7ee9a1bc1ca (dataset): DatasetConfig { id: 20e2e7d1-97d3-4a1c-8317-b7ee9a1bc1ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2208b6a5-e740-46da-8fbd-408acebcfc52 (dataset): DatasetConfig { id: 2208b6a5-e740-46da-8fbd-408acebcfc52 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 291739af-65f0-45d2-ba6d-6fe86a753b08 (dataset): DatasetConfig { id: 291739af-65f0-45d2-ba6d-6fe86a753b08 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 297fb9ad-6cf6-41fd-9417-4f1cec267652 (dataset): DatasetConfig { id: 297fb9ad-6cf6-41fd-9417-4f1cec267652 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32011fd6-908c-49e7-9c06-8ad3bd23fac1 (dataset): DatasetConfig { id: 32011fd6-908c-49e7-9c06-8ad3bd23fac1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33fdfa77-8c1f-4072-97ad-335a661580dc (dataset): DatasetConfig { id: 33fdfa77-8c1f-4072-97ad-335a661580dc (dataset), name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 35bcab0e-647b-4242-bd83-5221f2302c89 (dataset): DatasetConfig { id: 35bcab0e-647b-4242-bd83-5221f2302c89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37d7b04f-d4af-4dd3-a412-9f42694b3e1b (dataset): DatasetConfig { id: 37d7b04f-d4af-4dd3-a412-9f42694b3e1b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3dcc07be-b015-4f18-b4cc-4f1b5eb6c953 (dataset): DatasetConfig { id: 3dcc07be-b015-4f18-b4cc-4f1b5eb6c953 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40c4239e-af26-4b7f-88df-836104a1b711 (dataset): DatasetConfig { id: 40c4239e-af26-4b7f-88df-836104a1b711 (dataset), name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 41a6caaf-947d-4f8a-b36f-3c1fb6fde374 (dataset): DatasetConfig { id: 41a6caaf-947d-4f8a-b36f-3c1fb6fde374 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 438d4f9d-0a4c-4f28-91d0-6ee0d9e03702 (dataset): DatasetConfig { id: 438d4f9d-0a4c-4f28-91d0-6ee0d9e03702 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 475def3c-9e09-4a2c-917d-e00544dd910a (dataset): DatasetConfig { id: 475def3c-9e09-4a2c-917d-e00544dd910a (dataset), name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47d22f28-5042-4962-beed-250c6fc95976 (dataset): DatasetConfig { id: 47d22f28-5042-4962-beed-250c6fc95976 (dataset), name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 492b38f2-4e0d-4139-a1c7-dd7e23dc1c39 (dataset): DatasetConfig { id: 492b38f2-4e0d-4139-a1c7-dd7e23dc1c39 (dataset), name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f13e638-6923-44e3-a308-57a99a785c3d (dataset): DatasetConfig { id: 4f13e638-6923-44e3-a308-57a99a785c3d (dataset), name: DatasetName { pool_name: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56a03c21-cdd7-4fac-a72e-52e8865a7046 (dataset): DatasetConfig { id: 56a03c21-cdd7-4fac-a72e-52e8865a7046 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a4c56a7-dc95-45f7-a73c-32cf9da6433e (dataset): DatasetConfig { id: 5a4c56a7-dc95-45f7-a73c-32cf9da6433e (dataset), name: DatasetName { pool_name: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5c39bbb7-bbe6-45f6-a67e-36d3dbe4c5c1 (dataset): DatasetConfig { id: 5c39bbb7-bbe6-45f6-a67e-36d3dbe4c5c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f964510-87aa-46a3-8811-dff2025215c5 (dataset): DatasetConfig { id: 5f964510-87aa-46a3-8811-dff2025215c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61bc22b3-ccde-48eb-9be6-ba4f2e89fd0d (dataset): DatasetConfig { id: 61bc22b3-ccde-48eb-9be6-ba4f2e89fd0d (dataset), name: DatasetName { pool_name: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 62334285-db58-431f-9ba3-e9088058e682 (dataset): DatasetConfig { id: 62334285-db58-431f-9ba3-e9088058e682 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64addd2f-8979-450c-a83a-bbaf8d9df73e (dataset): DatasetConfig { id: 64addd2f-8979-450c-a83a-bbaf8d9df73e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6852b241-9cbb-4ae2-b964-49d370ff3909 (dataset): DatasetConfig { id: 6852b241-9cbb-4ae2-b964-49d370ff3909 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71b563fc-4739-4f16-a7af-a9c7dc2c32aa (dataset): DatasetConfig { id: 71b563fc-4739-4f16-a7af-a9c7dc2c32aa (dataset), name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72f56a4c-5e8e-45bf-8148-322ef26bc741 (dataset): DatasetConfig { id: 72f56a4c-5e8e-45bf-8148-322ef26bc741 (dataset), name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 78bb643e-c076-4ec9-a4da-6cd75ba00937 (dataset): DatasetConfig { id: 78bb643e-c076-4ec9-a4da-6cd75ba00937 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bbddab5-a099-468e-b68b-11a571eb18e1 (dataset): DatasetConfig { id: 7bbddab5-a099-468e-b68b-11a571eb18e1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d30b81f-9835-4b49-be12-979831ebabd9 (dataset): DatasetConfig { id: 7d30b81f-9835-4b49-be12-979831ebabd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 855ead10-b4df-4267-9665-947aac0e5f01 (dataset): DatasetConfig { id: 855ead10-b4df-4267-9665-947aac0e5f01 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8d06baa3-2564-453d-ae66-e4f8666503ef (dataset): DatasetConfig { id: 8d06baa3-2564-453d-ae66-e4f8666503ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 93309e4b-b501-40a8-b4ee-5d468a31e8a4 (dataset): DatasetConfig { id: 93309e4b-b501-40a8-b4ee-5d468a31e8a4 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 93e4b0c9-c4a4-4deb-8978-97f01613187f (dataset): DatasetConfig { id: 93e4b0c9-c4a4-4deb-8978-97f01613187f (dataset), name: DatasetName { pool_name: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7113576-6071-4f3e-a41b-2e991951d680 (dataset): DatasetConfig { id: a7113576-6071-4f3e-a41b-2e991951d680 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ae5d8151-d2a0-4892-8763-e11cd518e9b8 (dataset): DatasetConfig { id: ae5d8151-d2a0-4892-8763-e11cd518e9b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b21fbdfd-78c9-400f-a997-0b0f52dba99d (dataset): DatasetConfig { id: b21fbdfd-78c9-400f-a997-0b0f52dba99d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6d96424-5058-46ba-baf1-769c85ed4fc6 (dataset): DatasetConfig { id: b6d96424-5058-46ba-baf1-769c85ed4fc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b79a8354-7327-4d87-96e9-92d4bae526ea (dataset): DatasetConfig { id: b79a8354-7327-4d87-96e9-92d4bae526ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bcada8a0-bb3d-4aaf-a003-53b169f10f1f (dataset): DatasetConfig { id: bcada8a0-bb3d-4aaf-a003-53b169f10f1f (dataset), name: DatasetName { pool_name: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be4ea35c-fde0-4e30-9d62-a84557513e83 (dataset): DatasetConfig { id: be4ea35c-fde0-4e30-9d62-a84557513e83 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c35a93ad-23d4-45fe-bdc1-eb0f412d4dfb (dataset): DatasetConfig { id: c35a93ad-23d4-45fe-bdc1-eb0f412d4dfb (dataset), name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c3c1cd95-e69f-4547-95cc-1da59bdd82b3 (dataset): DatasetConfig { id: c3c1cd95-e69f-4547-95cc-1da59bdd82b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cd281d6b-e3e0-4be9-9909-df6ef7dfb7dc (dataset): DatasetConfig { id: cd281d6b-e3e0-4be9-9909-df6ef7dfb7dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4c5bbc0-c166-4a50-9f79-7e2014b7eac2 (dataset): DatasetConfig { id: d4c5bbc0-c166-4a50-9f79-7e2014b7eac2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dbedc5dc-8431-48e5-a162-593d07b57af9 (dataset): DatasetConfig { id: dbedc5dc-8431-48e5-a162-593d07b57af9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef13c033-6dfc-4325-9003-ce889b0735cb (dataset): DatasetConfig { id: ef13c033-6dfc-4325-9003-ce889b0735cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f17b8d09-5b83-4bd4-9575-4ab8d2826688 (dataset): DatasetConfig { id: f17b8d09-5b83-4bd4-9575-4ab8d2826688 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3983f18-017c-445e-9f2a-e653f32e3506 (dataset): DatasetConfig { id: f3983f18-017c-445e-9f2a-e653f32e3506 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f43d05b0-5981-4144-ac05-e24a8a92af01 (dataset): DatasetConfig { id: f43d05b0-5981-4144-ac05-e24a8a92af01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f452a354-4e75-4659-9e38-5b9dfd4af11c (dataset): DatasetConfig { id: f452a354-4e75-4659-9e38-5b9dfd4af11c (dataset), name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f46b9d40-3074-43ab-9bf5-23bc8dcce997 (dataset): DatasetConfig { id: f46b9d40-3074-43ab-9bf5-23bc8dcce997 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd9f229c-04cd-4b34-b213-b5e773f2beac (dataset): DatasetConfig { id: fd9f229c-04cd-4b34-b213-b5e773f2beac (dataset), name: DatasetName { pool_name: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, feb2e92b-b398-4888-9930-3bd8b5b7001c (dataset): DatasetConfig { id: feb2e92b-b398-4888-9930-3bd8b5b7001c (dataset), name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fee286f1-9dae-43da-bbdc-409ef27cf892 (dataset): DatasetConfig { id: fee286f1-9dae-43da-bbdc-409ef27cf892 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ffaeef37-5253-4029-be3c-5cf8ea9c81a9 (dataset): DatasetConfig { id: ffaeef37-5253-4029-be3c-5cf8ea9c81a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4562024-11-14T06:14:35.317ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54217
4572024-11-14T06:14:35.317ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:850 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
4582024-11-14T06:14:35.317ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0246f324-f80e-444b-98ed-abffe5a5bd9e (dataset): DatasetConfig { id: 0246f324-f80e-444b-98ed-abffe5a5bd9e (dataset), name: DatasetName { pool_name: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 03f31b63-1801-4e24-9d06-85cc54499a00 (dataset): DatasetConfig { id: 03f31b63-1801-4e24-9d06-85cc54499a00 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 046e9198-af0d-41b0-9419-9ecbe038328e (dataset): DatasetConfig { id: 046e9198-af0d-41b0-9419-9ecbe038328e (dataset), name: DatasetName { pool_name: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 09182161-cb48-4151-a340-a280be1f91df (dataset): DatasetConfig { id: 09182161-cb48-4151-a340-a280be1f91df (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 09f7b43d-eec9-425f-a4de-9d41c2860382 (dataset): DatasetConfig { id: 09f7b43d-eec9-425f-a4de-9d41c2860382 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e8fd62c-af02-414e-baa7-1a543a2854bf (dataset): DatasetConfig { id: 0e8fd62c-af02-414e-baa7-1a543a2854bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 15c9cdc9-3ae6-47a0-8248-60ec864965a1 (dataset): DatasetConfig { id: 15c9cdc9-3ae6-47a0-8248-60ec864965a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19078117-c104-4216-992b-fe30db9cf97c (dataset): DatasetConfig { id: 19078117-c104-4216-992b-fe30db9cf97c (dataset), name: DatasetName { pool_name: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1911efab-b77b-4875-a032-9db03556b64b (dataset): DatasetConfig { id: 1911efab-b77b-4875-a032-9db03556b64b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1dd9f849-1889-476a-ac01-966d390dea4e (dataset): DatasetConfig { id: 1dd9f849-1889-476a-ac01-966d390dea4e (dataset), name: DatasetName { pool_name: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 208104fa-3818-4224-90f4-db281a67e60f (dataset): DatasetConfig { id: 208104fa-3818-4224-90f4-db281a67e60f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20e2e7d1-97d3-4a1c-8317-b7ee9a1bc1ca (dataset): DatasetConfig { id: 20e2e7d1-97d3-4a1c-8317-b7ee9a1bc1ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2208b6a5-e740-46da-8fbd-408acebcfc52 (dataset): DatasetConfig { id: 2208b6a5-e740-46da-8fbd-408acebcfc52 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 291739af-65f0-45d2-ba6d-6fe86a753b08 (dataset): DatasetConfig { id: 291739af-65f0-45d2-ba6d-6fe86a753b08 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 297fb9ad-6cf6-41fd-9417-4f1cec267652 (dataset): DatasetConfig { id: 297fb9ad-6cf6-41fd-9417-4f1cec267652 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32011fd6-908c-49e7-9c06-8ad3bd23fac1 (dataset): DatasetConfig { id: 32011fd6-908c-49e7-9c06-8ad3bd23fac1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33fdfa77-8c1f-4072-97ad-335a661580dc (dataset): DatasetConfig { id: 33fdfa77-8c1f-4072-97ad-335a661580dc (dataset), name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 35bcab0e-647b-4242-bd83-5221f2302c89 (dataset): DatasetConfig { id: 35bcab0e-647b-4242-bd83-5221f2302c89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37d7b04f-d4af-4dd3-a412-9f42694b3e1b (dataset): DatasetConfig { id: 37d7b04f-d4af-4dd3-a412-9f42694b3e1b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3dcc07be-b015-4f18-b4cc-4f1b5eb6c953 (dataset): DatasetConfig { id: 3dcc07be-b015-4f18-b4cc-4f1b5eb6c953 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40c4239e-af26-4b7f-88df-836104a1b711 (dataset): DatasetConfig { id: 40c4239e-af26-4b7f-88df-836104a1b711 (dataset), name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 41a6caaf-947d-4f8a-b36f-3c1fb6fde374 (dataset): DatasetConfig { id: 41a6caaf-947d-4f8a-b36f-3c1fb6fde374 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 438d4f9d-0a4c-4f28-91d0-6ee0d9e03702 (dataset): DatasetConfig { id: 438d4f9d-0a4c-4f28-91d0-6ee0d9e03702 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 475def3c-9e09-4a2c-917d-e00544dd910a (dataset): DatasetConfig { id: 475def3c-9e09-4a2c-917d-e00544dd910a (dataset), name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47d22f28-5042-4962-beed-250c6fc95976 (dataset): DatasetConfig { id: 47d22f28-5042-4962-beed-250c6fc95976 (dataset), name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 492b38f2-4e0d-4139-a1c7-dd7e23dc1c39 (dataset): DatasetConfig { id: 492b38f2-4e0d-4139-a1c7-dd7e23dc1c39 (dataset), name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f13e638-6923-44e3-a308-57a99a785c3d (dataset): DatasetConfig { id: 4f13e638-6923-44e3-a308-57a99a785c3d (dataset), name: DatasetName { pool_name: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56a03c21-cdd7-4fac-a72e-52e8865a7046 (dataset): DatasetConfig { id: 56a03c21-cdd7-4fac-a72e-52e8865a7046 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a4c56a7-dc95-45f7-a73c-32cf9da6433e (dataset): DatasetConfig { id: 5a4c56a7-dc95-45f7-a73c-32cf9da6433e (dataset), name: DatasetName { pool_name: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5c39bbb7-bbe6-45f6-a67e-36d3dbe4c5c1 (dataset): DatasetConfig { id: 5c39bbb7-bbe6-45f6-a67e-36d3dbe4c5c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f964510-87aa-46a3-8811-dff2025215c5 (dataset): DatasetConfig { id: 5f964510-87aa-46a3-8811-dff2025215c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61bc22b3-ccde-48eb-9be6-ba4f2e89fd0d (dataset): DatasetConfig { id: 61bc22b3-ccde-48eb-9be6-ba4f2e89fd0d (dataset), name: DatasetName { pool_name: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 62334285-db58-431f-9ba3-e9088058e682 (dataset): DatasetConfig { id: 62334285-db58-431f-9ba3-e9088058e682 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64addd2f-8979-450c-a83a-bbaf8d9df73e (dataset): DatasetConfig { id: 64addd2f-8979-450c-a83a-bbaf8d9df73e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6852b241-9cbb-4ae2-b964-49d370ff3909 (dataset): DatasetConfig { id: 6852b241-9cbb-4ae2-b964-49d370ff3909 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71b563fc-4739-4f16-a7af-a9c7dc2c32aa (dataset): DatasetConfig { id: 71b563fc-4739-4f16-a7af-a9c7dc2c32aa (dataset), name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72f56a4c-5e8e-45bf-8148-322ef26bc741 (dataset): DatasetConfig { id: 72f56a4c-5e8e-45bf-8148-322ef26bc741 (dataset), name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 78bb643e-c076-4ec9-a4da-6cd75ba00937 (dataset): DatasetConfig { id: 78bb643e-c076-4ec9-a4da-6cd75ba00937 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bbddab5-a099-468e-b68b-11a571eb18e1 (dataset): DatasetConfig { id: 7bbddab5-a099-468e-b68b-11a571eb18e1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d30b81f-9835-4b49-be12-979831ebabd9 (dataset): DatasetConfig { id: 7d30b81f-9835-4b49-be12-979831ebabd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 855ead10-b4df-4267-9665-947aac0e5f01 (dataset): DatasetConfig { id: 855ead10-b4df-4267-9665-947aac0e5f01 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8d06baa3-2564-453d-ae66-e4f8666503ef (dataset): DatasetConfig { id: 8d06baa3-2564-453d-ae66-e4f8666503ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 93309e4b-b501-40a8-b4ee-5d468a31e8a4 (dataset): DatasetConfig { id: 93309e4b-b501-40a8-b4ee-5d468a31e8a4 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 93e4b0c9-c4a4-4deb-8978-97f01613187f (dataset): DatasetConfig { id: 93e4b0c9-c4a4-4deb-8978-97f01613187f (dataset), name: DatasetName { pool_name: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7113576-6071-4f3e-a41b-2e991951d680 (dataset): DatasetConfig { id: a7113576-6071-4f3e-a41b-2e991951d680 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ae5d8151-d2a0-4892-8763-e11cd518e9b8 (dataset): DatasetConfig { id: ae5d8151-d2a0-4892-8763-e11cd518e9b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b21fbdfd-78c9-400f-a997-0b0f52dba99d (dataset): DatasetConfig { id: b21fbdfd-78c9-400f-a997-0b0f52dba99d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6d96424-5058-46ba-baf1-769c85ed4fc6 (dataset): DatasetConfig { id: b6d96424-5058-46ba-baf1-769c85ed4fc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b79a8354-7327-4d87-96e9-92d4bae526ea (dataset): DatasetConfig { id: b79a8354-7327-4d87-96e9-92d4bae526ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bcada8a0-bb3d-4aaf-a003-53b169f10f1f (dataset): DatasetConfig { id: bcada8a0-bb3d-4aaf-a003-53b169f10f1f (dataset), name: DatasetName { pool_name: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be4ea35c-fde0-4e30-9d62-a84557513e83 (dataset): DatasetConfig { id: be4ea35c-fde0-4e30-9d62-a84557513e83 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c35a93ad-23d4-45fe-bdc1-eb0f412d4dfb (dataset): DatasetConfig { id: c35a93ad-23d4-45fe-bdc1-eb0f412d4dfb (dataset), name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c3c1cd95-e69f-4547-95cc-1da59bdd82b3 (dataset): DatasetConfig { id: c3c1cd95-e69f-4547-95cc-1da59bdd82b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cd281d6b-e3e0-4be9-9909-df6ef7dfb7dc (dataset): DatasetConfig { id: cd281d6b-e3e0-4be9-9909-df6ef7dfb7dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4c5bbc0-c166-4a50-9f79-7e2014b7eac2 (dataset): DatasetConfig { id: d4c5bbc0-c166-4a50-9f79-7e2014b7eac2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dbedc5dc-8431-48e5-a162-593d07b57af9 (dataset): DatasetConfig { id: dbedc5dc-8431-48e5-a162-593d07b57af9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef13c033-6dfc-4325-9003-ce889b0735cb (dataset): DatasetConfig { id: ef13c033-6dfc-4325-9003-ce889b0735cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f17b8d09-5b83-4bd4-9575-4ab8d2826688 (dataset): DatasetConfig { id: f17b8d09-5b83-4bd4-9575-4ab8d2826688 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3983f18-017c-445e-9f2a-e653f32e3506 (dataset): DatasetConfig { id: f3983f18-017c-445e-9f2a-e653f32e3506 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f43d05b0-5981-4144-ac05-e24a8a92af01 (dataset): DatasetConfig { id: f43d05b0-5981-4144-ac05-e24a8a92af01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f452a354-4e75-4659-9e38-5b9dfd4af11c (dataset): DatasetConfig { id: f452a354-4e75-4659-9e38-5b9dfd4af11c (dataset), name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f46b9d40-3074-43ab-9bf5-23bc8dcce997 (dataset): DatasetConfig { id: f46b9d40-3074-43ab-9bf5-23bc8dcce997 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd9f229c-04cd-4b34-b213-b5e773f2beac (dataset): DatasetConfig { id: fd9f229c-04cd-4b34-b213-b5e773f2beac (dataset), name: DatasetName { pool_name: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, feb2e92b-b398-4888-9930-3bd8b5b7001c (dataset): DatasetConfig { id: feb2e92b-b398-4888-9930-3bd8b5b7001c (dataset), name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fee286f1-9dae-43da-bbdc-409ef27cf892 (dataset): DatasetConfig { id: fee286f1-9dae-43da-bbdc-409ef27cf892 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ffaeef37-5253-4029-be3c-5cf8ea9c81a9 (dataset): DatasetConfig { id: ffaeef37-5253-4029-be3c-5cf8ea9c81a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4592024-11-14T06:14:35.317ZINFOSledAgent (StorageManager): No ledger in /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4602024-11-14T06:14:35.317ZINFOSledAgent (StorageManager): No ledger in /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4612024-11-14T06:14:35.317ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4622024-11-14T06:14:35.317ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4632024-11-14T06:14:35.317ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/93a2b028-0235-4af9-913d-cd3caeb886d5/crypt/debug"), full_name: "oxp_93a2b028-0235-4af9-913d-cd3caeb886d5/crypt/debug" } file = sled-storage/src/manager.rs:1331
4642024-11-14T06:14:35.383ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4652024-11-14T06:14:35.383ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3/crucible" } file = sled-storage/src/manager.rs:1331
4662024-11-14T06:14:35.471ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4672024-11-14T06:14:35.471ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/195bff2e-21e5-469e-88de-7266b55e8b12/crypt/zone/oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e"), full_name: "oxp_195bff2e-21e5-469e-88de-7266b55e8b12/crypt/zone/oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e" } file = sled-storage/src/manager.rs:1331
4682024-11-14T06:14:35.568ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4692024-11-14T06:14:35.568ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4702024-11-14T06:14:35.658ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4712024-11-14T06:14:35.658ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3687329d-db08-4cdf-99f1-652e017f6592/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
4722024-11-14T06:14:35.749ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4732024-11-14T06:14:35.749ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crypt/debug"), full_name: "oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crypt/debug" } file = sled-storage/src/manager.rs:1331
4742024-11-14T06:14:35.766ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d) file = sled-agent/src/probe_manager.rs:231 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
4752024-11-14T06:14:35.817ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4762024-11-14T06:14:35.817ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/195bff2e-21e5-469e-88de-7266b55e8b12/crypt/zone/oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b"), full_name: "oxp_195bff2e-21e5-469e-88de-7266b55e8b12/crypt/zone/oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b" } file = sled-storage/src/manager.rs:1331
4772024-11-14T06:14:35.918ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-11-14T06:14:35.918ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_93a2b028-0235-4af9-913d-cd3caeb886d5/crucible" } file = sled-storage/src/manager.rs:1331
4792024-11-14T06:14:36.002ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.084115098s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
4802024-11-14T06:14:36.006ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4812024-11-14T06:14:36.006ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3687329d-db08-4cdf-99f1-652e017f6592/crypt/zone/oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959"), full_name: "oxp_3687329d-db08-4cdf-99f1-652e017f6592/crypt/zone/oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959" } file = sled-storage/src/manager.rs:1331
4822024-11-14T06:14:36.104ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4832024-11-14T06:14:36.104ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/195bff2e-21e5-469e-88de-7266b55e8b12/crypt/zone"), full_name: "oxp_195bff2e-21e5-469e-88de-7266b55e8b12/crypt/zone" } file = sled-storage/src/manager.rs:1331
4842024-11-14T06:14:36.172ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4852024-11-14T06:14:36.172ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crypt/zone/oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453"), full_name: "oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crypt/zone/oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453" } file = sled-storage/src/manager.rs:1331
4862024-11-14T06:14:36.274ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4872024-11-14T06:14:36.274ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/zone/oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16"), full_name: "oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/zone/oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16" } file = sled-storage/src/manager.rs:1331
4882024-11-14T06:14:36.377ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4892024-11-14T06:14:36.377ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4902024-11-14T06:14:36.469ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4912024-11-14T06:14:36.469ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad99b41b-bddf-41c4-a707-9a9d5f683a3f/crypt/zone/oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a"), full_name: "oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f/crypt/zone/oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a" } file = sled-storage/src/manager.rs:1331
4922024-11-14T06:14:36.569ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4932024-11-14T06:14:36.569ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3687329d-db08-4cdf-99f1-652e017f6592/crypt/zone"), full_name: "oxp_3687329d-db08-4cdf-99f1-652e017f6592/crypt/zone" } file = sled-storage/src/manager.rs:1331
4942024-11-14T06:14:36.637ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4952024-11-14T06:14:36.637ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3687329d-db08-4cdf-99f1-652e017f6592/crucible" } file = sled-storage/src/manager.rs:1331
4962024-11-14T06:14:36.726ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4972024-11-14T06:14:36.726ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73/crucible" } file = sled-storage/src/manager.rs:1331
4982024-11-14T06:14:36.769ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d) file = sled-agent/src/probe_manager.rs:231 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
4992024-11-14T06:14:36.815ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5002024-11-14T06:14:36.815ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/195bff2e-21e5-469e-88de-7266b55e8b12/crypt/zone/oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3"), full_name: "oxp_195bff2e-21e5-469e-88de-7266b55e8b12/crypt/zone/oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3" } file = sled-storage/src/manager.rs:1331
5012024-11-14T06:14:36.913ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5022024-11-14T06:14:36.914ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/zone/oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5"), full_name: "oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/zone/oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5" } file = sled-storage/src/manager.rs:1331
5032024-11-14T06:14:37.011ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5042024-11-14T06:14:37.011ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4ce86c2f-d73a-421e-8735-58bc8979e498/crypt/zone/oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce"), full_name: "oxp_4ce86c2f-d73a-421e-8735-58bc8979e498/crypt/zone/oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce" } file = sled-storage/src/manager.rs:1331
5052024-11-14T06:14:37.108ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5062024-11-14T06:14:37.108ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ac1114a0-bdf6-4939-8af4-fb3fb61d8c73/crypt/zone/oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042"), full_name: "oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73/crypt/zone/oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042" } file = sled-storage/src/manager.rs:1331
5072024-11-14T06:14:37.208ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5082024-11-14T06:14:37.208ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5092024-11-14T06:14:37.299ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5102024-11-14T06:14:37.299ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crypt/zone/oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6"), full_name: "oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crypt/zone/oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6" } file = sled-storage/src/manager.rs:1331
5112024-11-14T06:14:37.396ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5122024-11-14T06:14:37.396ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374/crucible" } file = sled-storage/src/manager.rs:1331
5132024-11-14T06:14:37.482ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5142024-11-14T06:14:37.482ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ac1114a0-bdf6-4939-8af4-fb3fb61d8c73/crypt/zone"), full_name: "oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73/crypt/zone" } file = sled-storage/src/manager.rs:1331
5152024-11-14T06:14:37.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5162024-11-14T06:14:37.550ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5172024-11-14T06:14:37.640ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5182024-11-14T06:14:37.640ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad99b41b-bddf-41c4-a707-9a9d5f683a3f/crypt/zone/oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), full_name: "oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f/crypt/zone/oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa" } file = sled-storage/src/manager.rs:1331
5192024-11-14T06:14:37.738ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5202024-11-14T06:14:37.738ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/zone"), full_name: "oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/zone" } file = sled-storage/src/manager.rs:1331
5212024-11-14T06:14:37.771ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d) file = sled-agent/src/probe_manager.rs:231 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
5222024-11-14T06:14:37.807ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5232024-11-14T06:14:37.807ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/195bff2e-21e5-469e-88de-7266b55e8b12/crypt/debug"), full_name: "oxp_195bff2e-21e5-469e-88de-7266b55e8b12/crypt/debug" } file = sled-storage/src/manager.rs:1331
5242024-11-14T06:14:37.874ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5252024-11-14T06:14:37.874ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4ce86c2f-d73a-421e-8735-58bc8979e498/crucible" } file = sled-storage/src/manager.rs:1331
5262024-11-14T06:14:37.962ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5272024-11-14T06:14:37.962ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5282024-11-14T06:14:38.052ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5292024-11-14T06:14:38.052ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad99b41b-bddf-41c4-a707-9a9d5f683a3f/crypt/debug"), full_name: "oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f/crypt/debug" } file = sled-storage/src/manager.rs:1331
5302024-11-14T06:14:38.119ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5312024-11-14T06:14:38.119ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad807d5e-9724-4b8a-bcac-1d8b8e2fa374/crypt/zone/oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2"), full_name: "oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374/crypt/zone/oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2" } file = sled-storage/src/manager.rs:1331
5322024-11-14T06:14:38.220ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5332024-11-14T06:14:38.220ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3687329d-db08-4cdf-99f1-652e017f6592/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5342024-11-14T06:14:38.310ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5352024-11-14T06:14:38.310ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4ce86c2f-d73a-421e-8735-58bc8979e498/crypt/zone"), full_name: "oxp_4ce86c2f-d73a-421e-8735-58bc8979e498/crypt/zone" } file = sled-storage/src/manager.rs:1331
5362024-11-14T06:14:38.380ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5372024-11-14T06:14:38.380ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad807d5e-9724-4b8a-bcac-1d8b8e2fa374/crypt/zone/oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6"), full_name: "oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374/crypt/zone/oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6" } file = sled-storage/src/manager.rs:1331
5382024-11-14T06:14:38.478ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5392024-11-14T06:14:38.479ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ac1114a0-bdf6-4939-8af4-fb3fb61d8c73/crypt/debug"), full_name: "oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73/crypt/debug" } file = sled-storage/src/manager.rs:1331
5402024-11-14T06:14:38.546ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5412024-11-14T06:14:38.546ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3687329d-db08-4cdf-99f1-652e017f6592/crypt/zone/oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a"), full_name: "oxp_3687329d-db08-4cdf-99f1-652e017f6592/crypt/zone/oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a" } file = sled-storage/src/manager.rs:1331
5422024-11-14T06:14:38.644ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5432024-11-14T06:14:38.644ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3687329d-db08-4cdf-99f1-652e017f6592/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5442024-11-14T06:14:38.733ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5452024-11-14T06:14:38.733ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4ce86c2f-d73a-421e-8735-58bc8979e498/crypt/debug"), full_name: "oxp_4ce86c2f-d73a-421e-8735-58bc8979e498/crypt/debug" } file = sled-storage/src/manager.rs:1331
5462024-11-14T06:14:38.773ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d) file = sled-agent/src/probe_manager.rs:231 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
5472024-11-14T06:14:38.801ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5482024-11-14T06:14:38.801ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad807d5e-9724-4b8a-bcac-1d8b8e2fa374/crypt/zone/oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341"), full_name: "oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374/crypt/zone/oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341" } file = sled-storage/src/manager.rs:1331
5492024-11-14T06:14:38.900ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5502024-11-14T06:14:38.900ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crypt/zone/oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362"), full_name: "oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crypt/zone/oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362" } file = sled-storage/src/manager.rs:1331
5512024-11-14T06:14:38.998ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5522024-11-14T06:14:38.998ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad99b41b-bddf-41c4-a707-9a9d5f683a3f/crypt/zone"), full_name: "oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f/crypt/zone" } file = sled-storage/src/manager.rs:1331
5532024-11-14T06:14:39.067ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5542024-11-14T06:14:39.067ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/93a2b028-0235-4af9-913d-cd3caeb886d5/crypt/zone"), full_name: "oxp_93a2b028-0235-4af9-913d-cd3caeb886d5/crypt/zone" } file = sled-storage/src/manager.rs:1331
5552024-11-14T06:14:39.134ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5562024-11-14T06:14:39.134ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3687329d-db08-4cdf-99f1-652e017f6592/crypt/debug"), full_name: "oxp_3687329d-db08-4cdf-99f1-652e017f6592/crypt/debug" } file = sled-storage/src/manager.rs:1331
5572024-11-14T06:14:39.204ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5582024-11-14T06:14:39.204ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad807d5e-9724-4b8a-bcac-1d8b8e2fa374/crypt/zone"), full_name: "oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374/crypt/zone" } file = sled-storage/src/manager.rs:1331
5592024-11-14T06:14:39.273ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5602024-11-14T06:14:39.273ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5612024-11-14T06:14:39.363ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5622024-11-14T06:14:39.363ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/zone/oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908"), full_name: "oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/zone/oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908" } file = sled-storage/src/manager.rs:1331
5632024-11-14T06:14:39.464ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5642024-11-14T06:14:39.464ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/debug"), full_name: "oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/debug" } file = sled-storage/src/manager.rs:1331
5652024-11-14T06:14:39.533ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5662024-11-14T06:14:39.533ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/93a2b028-0235-4af9-913d-cd3caeb886d5/crypt/zone/oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19"), full_name: "oxp_93a2b028-0235-4af9-913d-cd3caeb886d5/crypt/zone/oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19" } file = sled-storage/src/manager.rs:1331
5672024-11-14T06:14:39.633ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5682024-11-14T06:14:39.634ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crypt/zone/oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34"), full_name: "oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crypt/zone/oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34" } file = sled-storage/src/manager.rs:1331
5692024-11-14T06:14:39.733ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5702024-11-14T06:14:39.733ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad807d5e-9724-4b8a-bcac-1d8b8e2fa374/crypt/debug"), full_name: "oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374/crypt/debug" } file = sled-storage/src/manager.rs:1331
5712024-11-14T06:14:39.775ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d) file = sled-agent/src/probe_manager.rs:231 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
5722024-11-14T06:14:39.817ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5732024-11-14T06:14:39.817ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad99b41b-bddf-41c4-a707-9a9d5f683a3f/crypt/zone/oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5"), full_name: "oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f/crypt/zone/oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5" } file = sled-storage/src/manager.rs:1331
5742024-11-14T06:14:39.922ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5752024-11-14T06:14:39.922ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3687329d-db08-4cdf-99f1-652e017f6592/crypt/zone/oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3"), full_name: "oxp_3687329d-db08-4cdf-99f1-652e017f6592/crypt/zone/oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3" } file = sled-storage/src/manager.rs:1331
5762024-11-14T06:14:40.024ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5772024-11-14T06:14:40.024ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3687329d-db08-4cdf-99f1-652e017f6592/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5782024-11-14T06:14:40.115ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5792024-11-14T06:14:40.115ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/zone/oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a"), full_name: "oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/zone/oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a" } file = sled-storage/src/manager.rs:1331
5802024-11-14T06:14:40.216ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5812024-11-14T06:14:40.216ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crypt/zone"), full_name: "oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crypt/zone" } file = sled-storage/src/manager.rs:1331
5822024-11-14T06:14:40.284ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5832024-11-14T06:14:40.284ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3687329d-db08-4cdf-99f1-652e017f6592/crypt/zone/oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73"), full_name: "oxp_3687329d-db08-4cdf-99f1-652e017f6592/crypt/zone/oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73" } file = sled-storage/src/manager.rs:1331
5842024-11-14T06:14:40.388ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5852024-11-14T06:14:40.388ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f/crucible" } file = sled-storage/src/manager.rs:1331
5862024-11-14T06:14:40.481ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5872024-11-14T06:14:40.481ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crucible" } file = sled-storage/src/manager.rs:1331
5882024-11-14T06:14:40.570ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5892024-11-14T06:14:40.570ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5902024-11-14T06:14:40.659ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5912024-11-14T06:14:40.659ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3687329d-db08-4cdf-99f1-652e017f6592/crypt/zone/oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed"), full_name: "oxp_3687329d-db08-4cdf-99f1-652e017f6592/crypt/zone/oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed" } file = sled-storage/src/manager.rs:1331
5922024-11-14T06:14:40.759ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5932024-11-14T06:14:40.759ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_195bff2e-21e5-469e-88de-7266b55e8b12/crucible" } file = sled-storage/src/manager.rs:1331
5942024-11-14T06:14:40.777ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d) file = sled-agent/src/probe_manager.rs:231 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
5952024-11-14T06:14:40.842ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5962024-11-14T06:14:40.842ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5972024-11-14T06:14:40.848ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
5982024-11-14T06:14:40.848ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
5992024-11-14T06:14:40.852ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6002024-11-14T06:14:40.852ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ac1114a0-bdf6-4939-8af4-fb3fb61d8c73/crypt/zone/oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52"), full_name: "oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73/crypt/zone/oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52" } file = sled-storage/src/manager.rs:1331
6012024-11-14T06:14:40.974ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6022024-11-14T06:14:40.974ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4ce86c2f-d73a-421e-8735-58bc8979e498/crypt/zone/oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb"), full_name: "oxp_4ce86c2f-d73a-421e-8735-58bc8979e498/crypt/zone/oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb" } file = sled-storage/src/manager.rs:1331
6032024-11-14T06:14:41.001ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
6042024-11-14T06:14:41.001ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
6052024-11-14T06:14:41.045ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
6062024-11-14T06:14:41.045ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
6072024-11-14T06:14:41.085ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6082024-11-14T06:14:41.085ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3687329d-db08-4cdf-99f1-652e017f6592/crypt/zone/oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353"), full_name: "oxp_3687329d-db08-4cdf-99f1-652e017f6592/crypt/zone/oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353" } file = sled-storage/src/manager.rs:1331
6092024-11-14T06:14:41.098ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6102024-11-14T06:14:41.098ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6112024-11-14T06:14:41.119ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6122024-11-14T06:14:41.119ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6132024-11-14T06:14:41.192ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6142024-11-14T06:14:41.192ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6152024-11-14T06:14:41.200ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6162024-11-14T06:14:41.200ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6172024-11-14T06:14:41.200ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:852 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
6182024-11-14T06:14:41.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5883763 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54217 req_id = 09935fb4-ca02-4131-961c-f3a88cc44d25 response_code = 200 uri = /datasets
6192024-11-14T06:14:41.250ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 78c1624f-34e7-40fb-a468-bb6354445b73 (service), filesystem_pool: Some(ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d40cb6d7-78a4-49d0-ae26-45907e21e06a (service), filesystem_pool: Some(ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 36c202a9-b541-4083-88f5-ff6483340b34 (service), filesystem_pool: Some(ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6202024-11-14T06:14:41.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56417
6212024-11-14T06:14:41.250ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 78c1624f-34e7-40fb-a468-bb6354445b73, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6222024-11-14T06:14:41.250ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 78c1624f-34e7-40fb-a468-bb6354445b73, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6232024-11-14T06:14:41.284ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d40cb6d7-78a4-49d0-ae26-45907e21e06a, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6242024-11-14T06:14:41.284ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d40cb6d7-78a4-49d0-ae26-45907e21e06a, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6252024-11-14T06:14:41.287ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6262024-11-14T06:14:41.287ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6272024-11-14T06:14:41.317ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 36c202a9-b541-4083-88f5-ff6483340b34, dataset_name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6282024-11-14T06:14:41.317ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 36c202a9-b541-4083-88f5-ff6483340b34, dataset_name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: InternalDns }, responder: ... }
6292024-11-14T06:14:41.332ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
6302024-11-14T06:14:41.333ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/27a56cb4-44ff-4d5b-931e-1c2c0642844d) file = sled-agent/src/nexus.rs:527 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
6312024-11-14T06:14:41.349ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6322024-11-14T06:14:41.349ZINFOSledAgent (ServiceManager): No ledger in /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/omicron-zones.json file = common/src/ledger.rs:188
6332024-11-14T06:14:41.349ZINFOSledAgent (ServiceManager): No ledger in /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/omicron-zones.json file = common/src/ledger.rs:188
6342024-11-14T06:14:41.349ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6352024-11-14T06:14:41.382ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
6362024-11-14T06:14:41.382ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
6372024-11-14T06:14:41.382ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 1
6382024-11-14T06:14:41.382ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
6392024-11-14T06:14:41.394ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6402024-11-14T06:14:41.394ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6412024-11-14T06:14:41.394ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6422024-11-14T06:14:41.451ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73 file = illumos-utils/src/zone.rs:325
6432024-11-14T06:14:41.455ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6442024-11-14T06:14:41.459ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a file = illumos-utils/src/zone.rs:325
6452024-11-14T06:14:41.463ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34 file = illumos-utils/src/zone.rs:325
6462024-11-14T06:14:41.473ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73 file = illumos-utils/src/zone.rs:363
6472024-11-14T06:14:41.480ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a file = illumos-utils/src/zone.rs:363
6482024-11-14T06:14:41.485ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34 file = illumos-utils/src/zone.rs:363
6492024-11-14T06:14:41.509ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6502024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6512024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6522024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6532024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6542024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6552024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6562024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6572024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6582024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6592024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6602024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6612024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6622024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6632024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6642024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6652024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6662024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6672024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6682024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6692024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6702024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6712024-11-14T06:14:41.509ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6722024-11-14T06:14:41.601ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12851144142733772692 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
6732024-11-14T06:14:41.601ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4427819933368741742 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
6742024-11-14T06:14:41.779ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d) file = sled-agent/src/probe_manager.rs:231 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
6752024-11-14T06:14:42.083ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
6762024-11-14T06:14:42.083ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
6772024-11-14T06:14:43.087ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6782024-11-14T06:14:43.088ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6792024-11-14T06:14:43.088ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73
6802024-11-14T06:14:43.574ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812024-11-14T06:14:44.054ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6822024-11-14T06:14:44.055ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6832024-11-14T06:14:44.055ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6842024-11-14T06:14:44.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73") failed: Property not found. retry in 56.873181ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73
6852024-11-14T06:14:44.063ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a
6862024-11-14T06:14:44.067ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34
6872024-11-14T06:14:44.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73") failed: Property not found. retry in 85.54402ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73
6882024-11-14T06:14:44.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a") failed: Property not found. retry in 42.825848ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a
6892024-11-14T06:14:44.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34") failed: Property not found. retry in 54.246972ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34
6902024-11-14T06:14:44.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73") failed: Property not found. retry in 272.56267ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73
6912024-11-14T06:14:44.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a") failed: Property not found. retry in 104.836109ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a
6922024-11-14T06:14:44.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34") failed: Property not found. retry in 62.382923ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34
6932024-11-14T06:14:44.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a") failed: Property not found. retry in 173.892285ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a
6942024-11-14T06:14:44.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34") failed: Property not found. retry in 270.680069ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34
6952024-11-14T06:14:44.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73") failed: Property not found. retry in 236.028713ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73
6962024-11-14T06:14:44.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a") failed: Property not found. retry in 294.880022ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a
6972024-11-14T06:14:44.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73") failed: Property not found. retry in 963.020996ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73
6982024-11-14T06:14:44.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34") failed: Property not found. retry in 303.677161ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34
6992024-11-14T06:14:44.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a") failed: Property not found. retry in 886.925844ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a
7002024-11-14T06:14:45.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34") failed: Property not found. retry in 526.71294ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34
7012024-11-14T06:14:45.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34") failed: Property not found. retry in 1.059947873s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34
7022024-11-14T06:14:45.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73") failed: Property not found. retry in 1.20135637s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73
7032024-11-14T06:14:45.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a") failed: Property not found. retry in 1.340133255s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a
7042024-11-14T06:14:46.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34") failed: Property not found. retry in 684.321941ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34
7052024-11-14T06:14:46.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73") failed: Property not found. retry in 1.316286923s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73
7062024-11-14T06:14:47.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a") failed: Property not found. retry in 547.238416ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a
7072024-11-14T06:14:47.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34") failed: Property not found. retry in 687.877535ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34
7082024-11-14T06:14:47.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a") failed: Property not found. retry in 794.003129ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a
7092024-11-14T06:14:48.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34") failed: Property not found. retry in 1.397949791s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34
7102024-11-14T06:14:48.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73") failed: Property not found. retry in 1.090141524s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73
7112024-11-14T06:14:48.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a") failed: Property not found. retry in 569.111141ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a
7122024-11-14T06:14:49.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a") failed: Property not found. retry in 1.065789335s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a
7132024-11-14T06:14:49.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73") failed: Property not found. retry in 993.028827ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73
7142024-11-14T06:14:49.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34") failed: Property not found. retry in 847.844488ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34
7152024-11-14T06:14:50.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a") failed: Property not found. retry in 1.158254624s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a
7162024-11-14T06:14:50.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34") failed: Property not found. retry in 1.282163669s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34
7172024-11-14T06:14:51.603ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12851144142733772692 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
7182024-11-14T06:14:51.603ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4427819933368741742 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
7192024-11-14T06:14:51.682ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_78c1624f-34e7-40fb-a468-bb6354445b73
7202024-11-14T06:14:51.682ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_d40cb6d7-78a4-49d0-ae26-45907e21e06a
7212024-11-14T06:14:51.682ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_36c202a9-b541-4083-88f5-ff6483340b34
7222024-11-14T06:14:51.682ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7232024-11-14T06:14:51.682ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7242024-11-14T06:14:51.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10432757 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56417 req_id = 91f6e121-de81-45e1-aed1-1fc6e126f3b6 response_code = 204 uri = /omicron-zones
7252024-11-14T06:14:51.685ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7262024-11-14T06:14:52.085ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
7272024-11-14T06:14:52.085ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
7282024-11-14T06:14:53.532ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 103.553364ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7292024-11-14T06:14:53.636ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 105.807993ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7302024-11-14T06:14:53.843ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7312024-11-14T06:14:55.047ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7322024-11-14T06:14:55.125ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7332024-11-14T06:14:55.125ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7342024-11-14T06:14:55.156ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7352024-11-14T06:14:55.157ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7362024-11-14T06:14:55.157ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7372024-11-14T06:14:55.186ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 78c1624f-34e7-40fb-a468-bb6354445b73 (service), filesystem_pool: Some(ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d40cb6d7-78a4-49d0-ae26-45907e21e06a (service), filesystem_pool: Some(ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 36c202a9-b541-4083-88f5-ff6483340b34 (service), filesystem_pool: Some(ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: e12f9da1-fe16-45b0-82ee-185f055731e3 (service), filesystem_pool: Some(ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: b4bad1d6-f2c7-40d7-adcb-b0777e111268, kind: Service { id: e12f9da1-fe16-45b0-82ee-185f055731e3 }, name: Name("ntp-e12f9da1-fe16-45b0-82ee-185f055731e3"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 152])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7382024-11-14T06:14:55.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33227
7392024-11-14T06:14:55.186ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 78c1624f-34e7-40fb-a468-bb6354445b73, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7402024-11-14T06:14:55.186ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 78c1624f-34e7-40fb-a468-bb6354445b73, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7412024-11-14T06:14:55.252ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d40cb6d7-78a4-49d0-ae26-45907e21e06a, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7422024-11-14T06:14:55.252ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d40cb6d7-78a4-49d0-ae26-45907e21e06a, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7432024-11-14T06:14:55.321ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 36c202a9-b541-4083-88f5-ff6483340b34, dataset_name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7442024-11-14T06:14:55.321ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 36c202a9-b541-4083-88f5-ff6483340b34, dataset_name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: InternalDns }, responder: ... }
7452024-11-14T06:14:55.372ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7462024-11-14T06:14:55.372ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/omicron-zones.json file = common/src/ledger.rs:177
7472024-11-14T06:14:55.372ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/omicron-zones.json file = common/src/ledger.rs:177
7482024-11-14T06:14:55.372ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7492024-11-14T06:14:55.383ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7502024-11-14T06:14:55.416ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7512024-11-14T06:14:55.416ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7522024-11-14T06:14:55.416ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7532024-11-14T06:14:55.445ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 203, 152]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7542024-11-14T06:14:55.446ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7552024-11-14T06:14:55.446ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7562024-11-14T06:14:55.446ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7572024-11-14T06:14:55.446ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7582024-11-14T06:14:55.446ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7592024-11-14T06:14:55.470ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3 file = illumos-utils/src/zone.rs:325
7602024-11-14T06:14:55.488ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3 file = illumos-utils/src/zone.rs:363
7612024-11-14T06:14:56.090ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7622024-11-14T06:14:56.090ZINFOSledAgent (ServiceManager): Booting oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3
7632024-11-14T06:14:56.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3") failed: Property not found. retry in 69.936722ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3
7642024-11-14T06:14:56.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3") failed: Property not found. retry in 121.976041ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3
7652024-11-14T06:14:56.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3") failed: Property not found. retry in 218.049155ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3
7662024-11-14T06:14:56.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3") failed: Property not found. retry in 367.437689ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3
7672024-11-14T06:14:57.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3") failed: Property not found. retry in 757.395512ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3
7682024-11-14T06:14:57.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3") failed: Property not found. retry in 910.576513ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3
7692024-11-14T06:14:58.097ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/27a56cb4-44ff-4d5b-931e-1c2c0642844d) file = sled-agent/src/probe_manager.rs:231 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
7702024-11-14T06:14:58.339ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/27a56cb4-44ff-4d5b-931e-1c2c0642844d) file = sled-agent/src/nexus.rs:527 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
7712024-11-14T06:14:58.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3") failed: Property not found. retry in 1.491690898s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3
7722024-11-14T06:15:00.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3") failed: Property not found. retry in 969.633198ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3
7732024-11-14T06:15:00.420ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5972798696080179253 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
7742024-11-14T06:15:01.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3") failed: Property not found. retry in 563.656699ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3
7752024-11-14T06:15:01.421ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13460296795756593589 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
7762024-11-14T06:15:01.604ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12851144142733772692 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
7772024-11-14T06:15:01.604ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4427819933368741742 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
7782024-11-14T06:15:01.684ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18029187732786610508 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
7792024-11-14T06:15:01.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3") failed: Property not found. retry in 1.349286355s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3
7802024-11-14T06:15:02.087ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
7812024-11-14T06:15:02.087ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
7822024-11-14T06:15:03.168ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3
7832024-11-14T06:15:03.168ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7842024-11-14T06:15:03.169ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7852024-11-14T06:15:03.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7983131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33227 req_id = 765ba03e-3770-457a-bae3-a1e511ee48c8 response_code = 204 uri = /omicron-zones
7862024-11-14T06:15:03.172ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7872024-11-14T06:15:03.201ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7882024-11-14T06:15:03.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65088
7892024-11-14T06:15:03.211ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7902024-11-14T06:15:03.211ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65088 req_id = 87f17c7a-67c0-4442-afed-fce6b8bd5899 response_code = 500 uri = /timesync
7912024-11-14T06:15:03.213ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7922024-11-14T06:15:03.302ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7932024-11-14T06:15:03.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55197
7942024-11-14T06:15:07.311ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7952024-11-14T06:15:07.311ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008871 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55197 req_id = 065f6268-00fb-4a42-bc57-30d0792bd54d response_code = 500 uri = /timesync
7962024-11-14T06:15:07.314ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7972024-11-14T06:15:07.509ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7982024-11-14T06:15:07.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48629
7992024-11-14T06:15:07.518ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8002024-11-14T06:15:07.518ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8561 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48629 req_id = 77848fbf-8cdb-478f-b437-4cc2c8729ec6 response_code = 500 uri = /timesync
8012024-11-14T06:15:07.520ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8022024-11-14T06:15:07.725ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8032024-11-14T06:15:07.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43837
8042024-11-14T06:15:07.734ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e12f9da1-fe16-45b0-82ee-185f055731e3': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8052024-11-14T06:15:07.734ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8654 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43837 req_id = 2af43f32-8770-4e24-b446-7e34bdb87a60 response_code = 500 uri = /timesync
8062024-11-14T06:15:07.737ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8072024-11-14T06:15:07.885ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8082024-11-14T06:15:07.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43815
8092024-11-14T06:15:09.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008595 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43815 req_id = ff8add77-4d7d-4c2a-8365-ce0049805dad response_code = 200 uri = /timesync
8102024-11-14T06:15:09.897ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8112024-11-14T06:15:09.897ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8122024-11-14T06:15:10.067ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8132024-11-14T06:15:10.068ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53170
8142024-11-14T06:15:10.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8653 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53170 req_id = 0aaabac7-947c-4467-a53f-12509a948f66 response_code = 200 uri = /timesync
8152024-11-14T06:15:10.080ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8162024-11-14T06:15:10.080ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8172024-11-14T06:15:10.118ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5972798696080179253 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8182024-11-14T06:15:10.164ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8192024-11-14T06:15:10.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46911
8202024-11-14T06:15:10.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8826 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46911 req_id = 78a917b8-bf53-4e81-9146-00a2b4cdbda1 response_code = 200 uri = /timesync
8212024-11-14T06:15:10.177ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8222024-11-14T06:15:10.177ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8232024-11-14T06:15:10.174ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8242024-11-14T06:15:10.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61482
8252024-11-14T06:15:10.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8651 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61482 req_id = ed67b87d-c980-4bdc-a934-2055ea836cf8 response_code = 200 uri = /timesync
8262024-11-14T06:15:10.185ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8272024-11-14T06:15:10.185ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8282024-11-14T06:15:10.323ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38848
8292024-11-14T06:15:10.323ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38848 req_id = 604d7ab6-cd29-4c54-a7ee-663e0562df63 response_code = 200 uri = /baseboard
8302024-11-14T06:15:10.529ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8312024-11-14T06:15:10.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47789
8322024-11-14T06:15:10.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7437 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47789 req_id = 2eb3cadd-0d52-4214-9dd8-3b167e26e990 response_code = 200 uri = /timesync
8332024-11-14T06:15:10.540ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8342024-11-14T06:15:10.540ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8352024-11-14T06:15:10.716ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13460296795756593589 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8362024-11-14T06:15:10.821ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8372024-11-14T06:15:10.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41760
8382024-11-14T06:15:10.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8086 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41760 req_id = d50d484f-d8a4-43d4-80b5-992fdeb017af response_code = 200 uri = /timesync
8392024-11-14T06:15:10.831ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8402024-11-14T06:15:10.831ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8412024-11-14T06:15:10.898ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12851144142733772692 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8422024-11-14T06:15:10.898ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4427819933368741742 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8432024-11-14T06:15:10.978ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18029187732786610508 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8442024-11-14T06:15:12.161ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8452024-11-14T06:15:12.161ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8462024-11-14T06:15:12.199ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8472024-11-14T06:15:12.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58819
8482024-11-14T06:15:12.207ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 254.851064ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8492024-11-14T06:15:12.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58819 req_id = c265e4a1-da66-4a56-8c15-2fcbc709f7cd response_code = 200 uri = /timesync
8502024-11-14T06:15:12.212ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8512024-11-14T06:15:12.212ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8522024-11-14T06:15:13.077ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8532024-11-14T06:15:13.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34216
8542024-11-14T06:15:13.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8392 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34216 req_id = 0f3bc5bd-661e-45c5-bff6-b7eaab7e0789 response_code = 200 uri = /timesync
8552024-11-14T06:15:13.087ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731564912.2957673, correction: -0.47929585 } file = sled-agent/src/rack_setup/service.rs:740
8562024-11-14T06:15:13.087ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8572024-11-14T06:15:13.243ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8993430026138312560 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8582024-11-14T06:15:13.243ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9638745435403782808 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8592024-11-14T06:15:14.214ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8602024-11-14T06:15:14.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55676
8612024-11-14T06:15:14.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55676 req_id = 7740798b-65a2-43b1-8d16-59d39765194a response_code = 200 uri = /timesync
8622024-11-14T06:15:14.225ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731564911.4409409, correction: -0.478912443 } file = sled-agent/src/rack_setup/service.rs:740
8632024-11-14T06:15:14.225ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8642024-11-14T06:15:15.008ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8652024-11-14T06:15:15.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41543
8662024-11-14T06:15:15.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9598 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41543 req_id = ad775c2b-1fc8-4b19-a4d3-740d5f4f4d5e response_code = 200 uri = /timesync
8672024-11-14T06:15:15.020ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731564911.4409409, correction: -0.476752877 } file = sled-agent/src/rack_setup/service.rs:740
8682024-11-14T06:15:15.020ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8692024-11-14T06:15:16.525ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8702024-11-14T06:15:16.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34296
8712024-11-14T06:15:16.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8756 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34296 req_id = 0b458f02-6b55-48fb-b6c5-637cb343df4c response_code = 200 uri = /timesync
8722024-11-14T06:15:16.536ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731564911.4409409, correction: -0.46856311 } file = sled-agent/src/rack_setup/service.rs:740
8732024-11-14T06:15:16.536ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8742024-11-14T06:15:17.940ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8752024-11-14T06:15:17.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36356
8762024-11-14T06:15:17.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9041 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36356 req_id = e8025f8c-39e2-4dff-894f-467a2a600b31 response_code = 200 uri = /timesync
8772024-11-14T06:15:17.952ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731564915.770603, correction: -0.463408113 } file = sled-agent/src/rack_setup/service.rs:740
8782024-11-14T06:15:17.952ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8792024-11-14T06:15:19.309ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8802024-11-14T06:15:19.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35186
8812024-11-14T06:15:19.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8780 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35186 req_id = 846f23af-def4-46f6-9909-d18e4b515c05 response_code = 200 uri = /timesync
8822024-11-14T06:15:19.321ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731564917.840248, correction: -0.459646463 } file = sled-agent/src/rack_setup/service.rs:740
8832024-11-14T06:15:19.321ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8842024-11-14T06:15:20.476ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5972798696080179253 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8852024-11-14T06:15:21.479ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8862024-11-14T06:15:21.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41394
8872024-11-14T06:15:21.484ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13460296795756593589 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8882024-11-14T06:15:21.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9005 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41394 req_id = f36defcc-86e5-4f3a-97a7-024a91771848 response_code = 200 uri = /timesync
8892024-11-14T06:15:21.492ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731564919.7950134, correction: -0.45365715 } file = sled-agent/src/rack_setup/service.rs:740
8902024-11-14T06:15:21.492ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8912024-11-14T06:15:21.657ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12851144142733772692 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8922024-11-14T06:15:21.657ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4427819933368741742 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8932024-11-14T06:15:21.736ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18029187732786610508 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8942024-11-14T06:15:22.137ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8952024-11-14T06:15:22.137ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8962024-11-14T06:15:23.218ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8993430026138312560 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8972024-11-14T06:15:23.218ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9638745435403782808 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
8982024-11-14T06:15:23.760ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8992024-11-14T06:15:23.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53877
9002024-11-14T06:15:23.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53877 req_id = 2064c8ae-9e20-4b0f-8121-7d0393f59224 response_code = 200 uri = /timesync
9012024-11-14T06:15:23.773ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731564922.5103314, correction: -0.447545886 } file = sled-agent/src/rack_setup/service.rs:740
9022024-11-14T06:15:23.773ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9032024-11-14T06:15:25.670ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9042024-11-14T06:15:25.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47108
9052024-11-14T06:15:25.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8581 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47108 req_id = 88ee7e52-25da-4d2f-9c3c-8cfad7b9ed81 response_code = 200 uri = /timesync
9062024-11-14T06:15:25.683ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731564924.4790187, correction: -0.442303985 } file = sled-agent/src/rack_setup/service.rs:740
9072024-11-14T06:15:25.683ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9082024-11-14T06:15:27.458ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 330.942927ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9092024-11-14T06:15:29.335ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9102024-11-14T06:15:29.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38124
9112024-11-14T06:15:29.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8633 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38124 req_id = 6e1c7ecd-2ccd-4fa1-b88a-7758ebbad0be response_code = 200 uri = /timesync
9122024-11-14T06:15:29.348ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731564928.0544815, correction: -0.43231222 } file = sled-agent/src/rack_setup/service.rs:740
9132024-11-14T06:15:29.348ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9142024-11-14T06:15:30.452ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5972798696080179253 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9152024-11-14T06:15:31.459ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13460296795756593589 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9162024-11-14T06:15:31.631ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 12851144142733772692 reason = Duration(60s) sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9172024-11-14T06:15:31.632ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4427819933368741742 reason = Duration(60s) sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9182024-11-14T06:15:31.710ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18029187732786610508 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9192024-11-14T06:15:32.112ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9202024-11-14T06:15:32.112ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9212024-11-14T06:15:33.193ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8993430026138312560 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9222024-11-14T06:15:33.193ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9638745435403782808 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9232024-11-14T06:15:34.146ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9242024-11-14T06:15:34.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43499
9252024-11-14T06:15:34.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43499 req_id = 0ac290d0-b0bf-4de6-b469-f081fbac200b response_code = 200 uri = /timesync
9262024-11-14T06:15:34.160ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731564932.7141786, correction: -0.419206262 } file = sled-agent/src/rack_setup/service.rs:740
9272024-11-14T06:15:34.160ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9282024-11-14T06:15:37.340ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9292024-11-14T06:15:37.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40359
9302024-11-14T06:15:37.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40359 req_id = 0ed7508a-f605-48cd-8691-f1789cd3b74c response_code = 200 uri = /timesync
9312024-11-14T06:15:37.354ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731564936.1303835, correction: -0.41060102 } file = sled-agent/src/rack_setup/service.rs:740
9322024-11-14T06:15:37.354ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9332024-11-14T06:15:40.427ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5972798696080179253 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9342024-11-14T06:15:41.062ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37937
9352024-11-14T06:15:41.062ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37937 req_id = cde2fb61-52b9-4bce-886a-34c7cd6a588c response_code = 200 uri = /baseboard
9362024-11-14T06:15:41.433ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13460296795756593589 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9372024-11-14T06:15:41.685ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18029187732786610508 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9382024-11-14T06:15:42.087ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9392024-11-14T06:15:42.087ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9402024-11-14T06:15:42.781ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 646.496522ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9412024-11-14T06:15:43.169ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8993430026138312560 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9422024-11-14T06:15:43.169ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9638745435403782808 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9432024-11-14T06:15:43.658ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9442024-11-14T06:15:43.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36875
9452024-11-14T06:15:43.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8993 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36875 req_id = a627ff16-3f06-4e20-9366-af52da30d375 response_code = 200 uri = /timesync
9462024-11-14T06:15:43.669ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731564942.7238617, correction: -0.393099517 } file = sled-agent/src/rack_setup/service.rs:740
9472024-11-14T06:15:43.669ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9482024-11-14T06:15:48.648ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9492024-11-14T06:15:48.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34869
9502024-11-14T06:15:48.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8782 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34869 req_id = a00e1a3f-ea97-4d61-9867-2e2f1ef7e001 response_code = 200 uri = /timesync
9512024-11-14T06:15:48.659ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731564947.5978804, correction: -0.380045474 } file = sled-agent/src/rack_setup/service.rs:740
9522024-11-14T06:15:48.659ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9532024-11-14T06:15:50.401ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5972798696080179253 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9542024-11-14T06:15:51.408ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13460296795756593589 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9552024-11-14T06:15:51.659ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18029187732786610508 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9562024-11-14T06:15:52.062ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9572024-11-14T06:15:52.062ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9582024-11-14T06:15:53.143ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8993430026138312560 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9592024-11-14T06:15:53.144ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9638745435403782808 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9602024-11-14T06:15:55.693ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9612024-11-14T06:15:55.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62518
9622024-11-14T06:15:55.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8880 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62518 req_id = 5bf0ecfb-714d-4524-872a-fa14d2becefa response_code = 200 uri = /timesync
9632024-11-14T06:15:55.705ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731564947.5978804, correction: -0.360914171 } file = sled-agent/src/rack_setup/service.rs:740
9642024-11-14T06:15:55.705ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9652024-11-14T06:15:58.419ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.968495859s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9662024-11-14T06:16:00.377ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 5972798696080179253 reason = Duration(60s) sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9672024-11-14T06:16:01.411ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13460296795756593589 reason = Duration(60s) sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9682024-11-14T06:16:01.634ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 18029187732786610508 reason = Duration(60s) sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9692024-11-14T06:16:02.036ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9702024-11-14T06:16:02.036ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9712024-11-14T06:16:03.117ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8993430026138312560 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9722024-11-14T06:16:03.118ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9638745435403782808 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9732024-11-14T06:16:07.825ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9742024-11-14T06:16:07.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48757
9752024-11-14T06:16:07.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48757 req_id = 947e3c32-3a0f-4d01-b95d-68e9cd346835 response_code = 200 uri = /timesync
9762024-11-14T06:16:07.838ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731564966.0802088, correction: -0.330753684 } file = sled-agent/src/rack_setup/service.rs:740
9772024-11-14T06:16:07.838ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9782024-11-14T06:16:11.014ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55476
9792024-11-14T06:16:11.014ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55476 req_id = 9a4b079d-d335-421d-be38-c01ca8822f69 response_code = 200 uri = /baseboard
9802024-11-14T06:16:12.010ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9812024-11-14T06:16:12.011ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9822024-11-14T06:16:13.092ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8993430026138312560 reason = Duration(60s) sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9832024-11-14T06:16:13.092ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 9638745435403782808 reason = Duration(60s) sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9842024-11-14T06:16:16.329ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9852024-11-14T06:16:16.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48828
9862024-11-14T06:16:16.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8811 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48828 req_id = 9f2f538b-6aae-4bbe-a35e-b4be9ead1b1f response_code = 200 uri = /timesync
9872024-11-14T06:16:16.343ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731564971.6421158, correction: -0.307628334 } file = sled-agent/src/rack_setup/service.rs:740
9882024-11-14T06:16:16.343ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9892024-11-14T06:16:16.372ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.074120423s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9902024-11-14T06:16:21.986ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9912024-11-14T06:16:21.987ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9922024-11-14T06:16:31.962ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9932024-11-14T06:16:31.962ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
9942024-11-14T06:16:33.056ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9952024-11-14T06:16:33.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37547
9962024-11-14T06:16:33.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8812 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37547 req_id = 9a827abb-66b9-4f28-a6d7-c88d1b06b319 response_code = 200 uri = /timesync
9972024-11-14T06:16:33.069ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731564988.0205865, correction: -0.262181848 } file = sled-agent/src/rack_setup/service.rs:740
9982024-11-14T06:16:33.069ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9992024-11-14T06:16:35.429ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.47432104s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10002024-11-14T06:16:40.966ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64034
10012024-11-14T06:16:40.966ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64034 req_id = 567d06ca-365c-41ee-890d-7cd140c49158 response_code = 200 uri = /baseboard
10022024-11-14T06:16:41.936ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10032024-11-14T06:16:41.936ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10042024-11-14T06:16:51.912ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10052024-11-14T06:16:51.912ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10062024-11-14T06:16:56.406ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10072024-11-14T06:16:56.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55769
10082024-11-14T06:16:56.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55769 req_id = d7a0fbc5-0f23-4c09-9630-047d6714bd78 response_code = 200 uri = /timesync
10092024-11-14T06:16:56.418ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731565008.4742334, correction: -0.19885093 } file = sled-agent/src/rack_setup/service.rs:740
10102024-11-14T06:16:56.418ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
10112024-11-14T06:17:00.870ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 16.010198304s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10122024-11-14T06:17:01.886ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10132024-11-14T06:17:01.886ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10142024-11-14T06:17:10.922ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44890
10152024-11-14T06:17:10.922ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44890 req_id = 7786d1a4-b718-40cb-871f-9ccae644e378 response_code = 200 uri = /baseboard
10162024-11-14T06:17:11.861ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10172024-11-14T06:17:11.862ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10182024-11-14T06:17:12.060ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10192024-11-14T06:17:12.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54501
10202024-11-14T06:17:12.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9516 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54501 req_id = 70d7833d-a3a0-46a5-9c89-a1d43807b08c response_code = 200 uri = /timesync
10212024-11-14T06:17:12.074ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731565028.28186, correction: -0.156341806 } file = sled-agent/src/rack_setup/service.rs:740
10222024-11-14T06:17:12.074ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
10232024-11-14T06:17:21.836ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10242024-11-14T06:17:21.837ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10252024-11-14T06:17:27.804ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10262024-11-14T06:17:27.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40624
10272024-11-14T06:17:27.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8741 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40624 req_id = 0d0477d8-a201-4e54-a954-5bb350a68e1c response_code = 200 uri = /timesync
10282024-11-14T06:17:27.816ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731565044.4317002, correction: -0.113592699 } file = sled-agent/src/rack_setup/service.rs:740
10292024-11-14T06:17:27.816ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
10302024-11-14T06:17:31.811ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10312024-11-14T06:17:31.811ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10322024-11-14T06:17:31.830ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 27.045329406s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10332024-11-14T06:17:40.873ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40942
10342024-11-14T06:17:40.873ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40942 req_id = 7c4ce8f9-008a-4baf-bf7d-3ead4347136e response_code = 200 uri = /baseboard
10352024-11-14T06:17:41.787ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10362024-11-14T06:17:41.787ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10372024-11-14T06:17:49.537ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10382024-11-14T06:17:49.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50819
10392024-11-14T06:17:49.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8610 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50819 req_id = dc892197-05ed-4ae1-bd88-4adc2a0ff270 response_code = 200 uri = /timesync
10402024-11-14T06:17:49.549ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731565068.863281, correction: -0.054579064 } file = sled-agent/src/rack_setup/service.rs:740
10412024-11-14T06:17:49.549ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
10422024-11-14T06:17:51.762ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10432024-11-14T06:17:51.762ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10442024-11-14T06:18:01.737ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9061386295234698917 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10452024-11-14T06:18:01.737ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6256058333883898368 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10462024-11-14T06:18:10.828ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57006
10472024-11-14T06:18:10.828ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57006 req_id = 59b212d6-e6ca-4f69-bfd9-7b49e9b2c595 response_code = 200 uri = /baseboard
10482024-11-14T06:18:11.619ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10492024-11-14T06:18:11.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63616
10502024-11-14T06:18:11.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21592 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63616 req_id = 12e8f980-aea6-481f-bcd8-181cc95755d0 response_code = 200 uri = /timesync
10512024-11-14T06:18:11.643ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-14T06:15:31.632063804Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4427819933368741742 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10522024-11-14T06:18:11.643ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-14T06:16:13.092743476Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 9638745435403782808 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10532024-11-14T06:18:11.644ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-14T06:16:01.633990348Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 18029187732786610508 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10542024-11-14T06:18:11.644ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-14T06:16:13.092248936Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8993430026138312560 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10552024-11-14T06:18:11.644ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-14T06:16:01.411198866Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13460296795756593589 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10562024-11-14T06:18:11.644ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-14T06:15:31.631084506Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 12851144142733772692 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10572024-11-14T06:18:11.645ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-14T06:16:00.377153887Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 5972798696080179253 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10582024-11-14T06:18:11.646ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731565068.863281, correction: 1.507e-6 } file = sled-agent/src/rack_setup/service.rs:740
10592024-11-14T06:18:11.646ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1423
10602024-11-14T06:18:11.675ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 78c1624f-34e7-40fb-a468-bb6354445b73 (service), filesystem_pool: Some(ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d40cb6d7-78a4-49d0-ae26-45907e21e06a (service), filesystem_pool: Some(ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 36c202a9-b541-4083-88f5-ff6483340b34 (service), filesystem_pool: Some(ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: e12f9da1-fe16-45b0-82ee-185f055731e3 (service), filesystem_pool: Some(ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: b4bad1d6-f2c7-40d7-adcb-b0777e111268, kind: Service { id: e12f9da1-fe16-45b0-82ee-185f055731e3 }, name: Name("ntp-e12f9da1-fe16-45b0-82ee-185f055731e3"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 152])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 4a563dcb-2ed5-4fb8-86de-370211e6e353 (service), filesystem_pool: Some(ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External } } } }, OmicronZoneConfig { id: 19546b93-fd64-4c09-a6c7-77da2fc0e908 (service), filesystem_pool: Some(ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3648bb56-8607-4529-9907-140434fcc362 (service), filesystem_pool: Some(ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External } } } }, OmicronZoneConfig { id: bbd2de20-0068-44d9-8d0d-469be6553e52 (service), filesystem_pool: Some(ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1c91f0a1-4b19-410f-b53f-9f2f4d7c1341 (service), filesystem_pool: Some(ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10612024-11-14T06:18:11.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40409
10622024-11-14T06:18:11.676ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 78c1624f-34e7-40fb-a468-bb6354445b73, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10632024-11-14T06:18:11.676ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 78c1624f-34e7-40fb-a468-bb6354445b73, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10642024-11-14T06:18:11.713ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d40cb6d7-78a4-49d0-ae26-45907e21e06a, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10652024-11-14T06:18:11.713ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d40cb6d7-78a4-49d0-ae26-45907e21e06a, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10662024-11-14T06:18:11.752ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 36c202a9-b541-4083-88f5-ff6483340b34, dataset_name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10672024-11-14T06:18:11.753ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 36c202a9-b541-4083-88f5-ff6483340b34, dataset_name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: InternalDns }, responder: ... }
10682024-11-14T06:18:11.784ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4a563dcb-2ed5-4fb8-86de-370211e6e353, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10692024-11-14T06:18:11.784ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4a563dcb-2ed5-4fb8-86de-370211e6e353, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10702024-11-14T06:18:11.823ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 19546b93-fd64-4c09-a6c7-77da2fc0e908, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10712024-11-14T06:18:11.823ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 19546b93-fd64-4c09-a6c7-77da2fc0e908, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10722024-11-14T06:18:11.857ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3648bb56-8607-4529-9907-140434fcc362, dataset_name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10732024-11-14T06:18:11.857ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3648bb56-8607-4529-9907-140434fcc362, dataset_name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: Cockroach }, responder: ... }
10742024-11-14T06:18:11.895ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bbd2de20-0068-44d9-8d0d-469be6553e52, dataset_name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10752024-11-14T06:18:11.895ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: bbd2de20-0068-44d9-8d0d-469be6553e52, dataset_name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10762024-11-14T06:18:11.929ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1c91f0a1-4b19-410f-b53f-9f2f4d7c1341, dataset_name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10772024-11-14T06:18:11.929ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1c91f0a1-4b19-410f-b53f-9f2f4d7c1341, dataset_name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10782024-11-14T06:18:11.966ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10792024-11-14T06:18:11.966ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/omicron-zones.json file = common/src/ledger.rs:177
10802024-11-14T06:18:11.966ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/omicron-zones.json file = common/src/ledger.rs:177
10812024-11-14T06:18:11.967ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10822024-11-14T06:18:12.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10832024-11-14T06:18:12.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10842024-11-14T06:18:12.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10852024-11-14T06:18:12.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10862024-11-14T06:18:12.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10872024-11-14T06:18:12.147ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362 file = illumos-utils/src/zone.rs:325
10882024-11-14T06:18:12.151ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353 file = illumos-utils/src/zone.rs:325
10892024-11-14T06:18:12.155ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908 file = illumos-utils/src/zone.rs:325
10902024-11-14T06:18:12.160ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341 file = illumos-utils/src/zone.rs:325
10912024-11-14T06:18:12.165ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52 file = illumos-utils/src/zone.rs:325
10922024-11-14T06:18:12.170ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362 file = illumos-utils/src/zone.rs:363
10932024-11-14T06:18:12.174ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353 file = illumos-utils/src/zone.rs:363
10942024-11-14T06:18:12.178ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908 file = illumos-utils/src/zone.rs:363
10952024-11-14T06:18:12.183ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341 file = illumos-utils/src/zone.rs:363
10962024-11-14T06:18:12.188ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52 file = illumos-utils/src/zone.rs:363
10972024-11-14T06:18:13.808ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 43.633992555s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
10982024-11-14T06:18:15.067ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3648bb56-8607-4529-9907-140434fcc362'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10992024-11-14T06:18:15.068ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362
11002024-11-14T06:18:15.074ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='19546b93-fd64-4c09-a6c7-77da2fc0e908'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11012024-11-14T06:18:15.074ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11022024-11-14T06:18:15.189ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='4a563dcb-2ed5-4fb8-86de-370211e6e353'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11032024-11-14T06:18:15.189ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353
11042024-11-14T06:18:15.200ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1c91f0a1-4b19-410f-b53f-9f2f4d7c1341'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11052024-11-14T06:18:15.200ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341
11062024-11-14T06:18:15.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362") failed: Property not found. retry in 49.775742ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362
11072024-11-14T06:18:15.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 38.399843ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11082024-11-14T06:18:15.234ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='bbd2de20-0068-44d9-8d0d-469be6553e52'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11092024-11-14T06:18:15.234ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52
11102024-11-14T06:18:15.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 84.547651ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11112024-11-14T06:18:15.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362") failed: Property not found. retry in 50.676927ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362
11122024-11-14T06:18:15.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362") failed: Property not found. retry in 228.743277ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362
11132024-11-14T06:18:15.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 143.608637ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11142024-11-14T06:18:15.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 460.313327ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11152024-11-14T06:18:15.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362") failed: Property not found. retry in 599.793854ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362
11162024-11-14T06:18:15.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353") failed: Property not found. retry in 45.866341ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353
11172024-11-14T06:18:15.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341") failed: Property not found. retry in 74.178333ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341
11182024-11-14T06:18:15.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353") failed: Property not found. retry in 82.780763ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353
11192024-11-14T06:18:16.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52") failed: Property not found. retry in 57.874047ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52
11202024-11-14T06:18:16.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353") failed: Property not found. retry in 144.810292ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353
11212024-11-14T06:18:16.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341") failed: Property not found. retry in 94.999968ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341
11222024-11-14T06:18:16.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52") failed: Property not found. retry in 52.230612ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52
11232024-11-14T06:18:16.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353") failed: Property not found. retry in 351.445734ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353
11242024-11-14T06:18:16.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 896.08466ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11252024-11-14T06:18:16.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341") failed: Property not found. retry in 264.902721ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341
11262024-11-14T06:18:17.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52") failed: Property not found. retry in 175.187958ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52
11272024-11-14T06:18:17.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362") failed: Property not found. retry in 1.188075834s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362
11282024-11-14T06:18:17.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353") failed: Property not found. retry in 678.069119ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353
11292024-11-14T06:18:17.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52") failed: Property not found. retry in 389.977734ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52
11302024-11-14T06:18:17.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341") failed: Property not found. retry in 429.33706ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341
11312024-11-14T06:18:17.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 1.129207181s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11322024-11-14T06:18:17.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52") failed: Property not found. retry in 663.751966ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52
11332024-11-14T06:18:17.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341") failed: Property not found. retry in 1.028477001s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341
11342024-11-14T06:18:17.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353") failed: Property not found. retry in 874.569221ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353
11352024-11-14T06:18:18.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362") failed: Property not found. retry in 547.215749ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362
11362024-11-14T06:18:18.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52") failed: Property not found. retry in 1.064938158s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52
11372024-11-14T06:18:18.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 1.188156912s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11382024-11-14T06:18:18.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353") failed: Property not found. retry in 503.416201ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353
11392024-11-14T06:18:18.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341") failed: Property not found. retry in 736.833471ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341
11402024-11-14T06:18:18.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362") failed: Property not found. retry in 1.436684892s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362
11412024-11-14T06:18:19.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353") failed: Property not found. retry in 1.366062773s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353
11422024-11-14T06:18:19.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52") failed: Property not found. retry in 901.551571ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52
11432024-11-14T06:18:19.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341") failed: Property not found. retry in 1.107865656s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341
11442024-11-14T06:18:19.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 694.930462ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11452024-11-14T06:18:20.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362") failed: Property not found. retry in 653.113399ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362
11462024-11-14T06:18:20.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52") failed: Property not found. retry in 1.127859113s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52
11472024-11-14T06:18:20.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 1.469510951s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11482024-11-14T06:18:20.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341") failed: Property not found. retry in 875.956034ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341
11492024-11-14T06:18:20.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353") failed: Property not found. retry in 1.095712428s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353
11502024-11-14T06:18:20.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362") failed: Property not found. retry in 1.202150641s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362
11512024-11-14T06:18:21.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52") failed: Property not found. retry in 759.160244ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52
11522024-11-14T06:18:21.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341") failed: Property not found. retry in 1.338017806s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341
11532024-11-14T06:18:21.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353") failed: Property not found. retry in 808.961904ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353
11542024-11-14T06:18:22.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 1.357939249s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11552024-11-14T06:18:22.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362") failed: Property not found. retry in 1.064569861s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362
11562024-11-14T06:18:22.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52") failed: Property not found. retry in 625.87207ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52
11572024-11-14T06:18:22.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353") failed: Property not found. retry in 1.240107018s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353
11582024-11-14T06:18:22.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52") failed: Property not found. retry in 1.032248421s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52
11592024-11-14T06:18:22.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341") failed: Property not found. retry in 659.621084ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341
11602024-11-14T06:18:23.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362") failed: Property not found. retry in 854.896902ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362
11612024-11-14T06:18:23.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 1.145764537s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11622024-11-14T06:18:23.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341") failed: Property not found. retry in 512.361219ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341
11632024-11-14T06:18:23.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353") failed: Property not found. retry in 1.095163115s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353
11642024-11-14T06:18:23.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52") failed: Property not found. retry in 1.229069734s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52
11652024-11-14T06:18:24.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 870.660849ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11662024-11-14T06:18:25.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 1.444283231s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11672024-11-14T06:18:26.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 1.105366632s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11682024-11-14T06:18:28.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 581.534454ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11692024-11-14T06:18:28.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 937.974699ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11702024-11-14T06:18:29.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 956.066492ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11712024-11-14T06:18:30.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 1.245643245s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11722024-11-14T06:18:32.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 1.462203935s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11732024-11-14T06:18:33.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908") failed: Property not found. retry in 1.361023099s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11742024-11-14T06:18:34.938ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_3648bb56-8607-4529-9907-140434fcc362
11752024-11-14T06:18:34.938ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_4a563dcb-2ed5-4fb8-86de-370211e6e353
11762024-11-14T06:18:34.938ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_19546b93-fd64-4c09-a6c7-77da2fc0e908
11772024-11-14T06:18:34.938ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_1c91f0a1-4b19-410f-b53f-9f2f4d7c1341
11782024-11-14T06:18:34.938ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_bbd2de20-0068-44d9-8d0d-469be6553e52
11792024-11-14T06:18:34.938ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11802024-11-14T06:18:34.939ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11812024-11-14T06:18:34.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23264807 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40409 req_id = 8b3461f0-d1d2-4013-a604-f5f9032ac135 response_code = 204 uri = /omicron-zones
11822024-11-14T06:18:34.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49064
11832024-11-14T06:18:35.004ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3743
11842024-11-14T06:18:37.713ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
11852024-11-14T06:18:40.252ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
11862024-11-14T06:18:40.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5277466 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:49064 req_id = 1576766a-39ed-4461-bdba-d52d3b508c68 response_code = 204 uri = /cockroachdb
11872024-11-14T06:18:40.287ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 78c1624f-34e7-40fb-a468-bb6354445b73 (service), filesystem_pool: Some(ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d40cb6d7-78a4-49d0-ae26-45907e21e06a (service), filesystem_pool: Some(ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 36c202a9-b541-4083-88f5-ff6483340b34 (service), filesystem_pool: Some(ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: e12f9da1-fe16-45b0-82ee-185f055731e3 (service), filesystem_pool: Some(ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: b4bad1d6-f2c7-40d7-adcb-b0777e111268, kind: Service { id: e12f9da1-fe16-45b0-82ee-185f055731e3 }, name: Name("ntp-e12f9da1-fe16-45b0-82ee-185f055731e3"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 152])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 4a563dcb-2ed5-4fb8-86de-370211e6e353 (service), filesystem_pool: Some(ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External } } } }, OmicronZoneConfig { id: 19546b93-fd64-4c09-a6c7-77da2fc0e908 (service), filesystem_pool: Some(ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3648bb56-8607-4529-9907-140434fcc362 (service), filesystem_pool: Some(ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External } } } }, OmicronZoneConfig { id: bbd2de20-0068-44d9-8d0d-469be6553e52 (service), filesystem_pool: Some(ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1c91f0a1-4b19-410f-b53f-9f2f4d7c1341 (service), filesystem_pool: Some(ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External } } } }, OmicronZoneConfig { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed (service), filesystem_pool: Some(ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 720ac48b-8596-4763-a661-482d124c0a16 (service), filesystem_pool: Some(ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 (service), filesystem_pool: Some(ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa (service), filesystem_pool: Some(ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a (service), filesystem_pool: Some(ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 (service), filesystem_pool: Some(ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 6f61ac48-36eb-4012-bb75-ab8f788b4959 (service), filesystem_pool: Some(ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6c36fb69-917c-4de7-bd2a-b235e97df27b (service), filesystem_pool: Some(ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 58f1ad07-a6fc-4f37-99d2-d577d50a1ab3 (service), filesystem_pool: Some(ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 07b31281-03e7-4f70-8104-fdc883991dfb (service), filesystem_pool: Some(ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: bfe850ec-84b4-4416-b7f1-ea945f66d71a (service), filesystem_pool: Some(ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External } } } }, OmicronZoneConfig { id: a75b84fe-728a-41f6-86dc-489dada09cf5 (service), filesystem_pool: Some(ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External } } } }, OmicronZoneConfig { id: b52cc325-34dc-4391-8b80-9ae50467c453 (service), filesystem_pool: Some(ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External } } } }, OmicronZoneConfig { id: 418d13cd-013b-4e47-9c44-69a57b40c042 (service), filesystem_pool: Some(ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External } } } }, OmicronZoneConfig { id: d97bbf94-0186-468c-a542-ed182541bef2 (service), filesystem_pool: Some(ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External } } } }, OmicronZoneConfig { id: 07eee81c-c4ad-4764-babe-66f1734ebdce (service), filesystem_pool: Some(ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External } } } }, OmicronZoneConfig { id: 480cc693-886b-4838-8e35-cffc144aaf19 (service), filesystem_pool: Some(ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External } } } }, OmicronZoneConfig { id: c9292d07-2415-41f8-8318-f13ebb88715e (service), filesystem_pool: Some(ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External } } } }, OmicronZoneConfig { id: 49a97aee-3d60-47c5-a5e1-f267ac53c8d5 (service), filesystem_pool: Some(ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
11882024-11-14T06:18:40.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39816
11892024-11-14T06:18:40.288ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 78c1624f-34e7-40fb-a468-bb6354445b73, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11902024-11-14T06:18:40.288ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 78c1624f-34e7-40fb-a468-bb6354445b73, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11912024-11-14T06:18:40.330ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d40cb6d7-78a4-49d0-ae26-45907e21e06a, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11922024-11-14T06:18:40.330ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d40cb6d7-78a4-49d0-ae26-45907e21e06a, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11932024-11-14T06:18:40.383ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 36c202a9-b541-4083-88f5-ff6483340b34, dataset_name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11942024-11-14T06:18:40.383ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 36c202a9-b541-4083-88f5-ff6483340b34, dataset_name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: InternalDns }, responder: ... }
11952024-11-14T06:18:40.423ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4a563dcb-2ed5-4fb8-86de-370211e6e353, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11962024-11-14T06:18:40.423ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4a563dcb-2ed5-4fb8-86de-370211e6e353, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11972024-11-14T06:18:40.454ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 19546b93-fd64-4c09-a6c7-77da2fc0e908, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11982024-11-14T06:18:40.454ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 19546b93-fd64-4c09-a6c7-77da2fc0e908, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11992024-11-14T06:18:40.488ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3648bb56-8607-4529-9907-140434fcc362, dataset_name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
12002024-11-14T06:18:40.488ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3648bb56-8607-4529-9907-140434fcc362, dataset_name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: Cockroach }, responder: ... }
12012024-11-14T06:18:40.527ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bbd2de20-0068-44d9-8d0d-469be6553e52, dataset_name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
12022024-11-14T06:18:40.527ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: bbd2de20-0068-44d9-8d0d-469be6553e52, dataset_name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12032024-11-14T06:18:40.561ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1c91f0a1-4b19-410f-b53f-9f2f4d7c1341, dataset_name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
12042024-11-14T06:18:40.561ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1c91f0a1-4b19-410f-b53f-9f2f4d7c1341, dataset_name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12052024-11-14T06:18:40.596ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f40de7f6-4bc1-4578-baeb-b08e777b4bed, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
12062024-11-14T06:18:40.596ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f40de7f6-4bc1-4578-baeb-b08e777b4bed, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12072024-11-14T06:18:40.630ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 720ac48b-8596-4763-a661-482d124c0a16, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
12082024-11-14T06:18:40.630ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 720ac48b-8596-4763-a661-482d124c0a16, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12092024-11-14T06:18:40.668ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6f61ac48-36eb-4012-bb75-ab8f788b4959, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
12102024-11-14T06:18:40.668ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6f61ac48-36eb-4012-bb75-ab8f788b4959, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12112024-11-14T06:18:40.706ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bfe850ec-84b4-4416-b7f1-ea945f66d71a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12122024-11-14T06:18:40.706ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: bfe850ec-84b4-4416-b7f1-ea945f66d71a, dataset_name: DatasetName { pool_name: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, kind: Crucible }, responder: ... }
12132024-11-14T06:18:40.740ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a75b84fe-728a-41f6-86dc-489dada09cf5, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12142024-11-14T06:18:40.740ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a75b84fe-728a-41f6-86dc-489dada09cf5, dataset_name: DatasetName { pool_name: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, kind: Crucible }, responder: ... }
12152024-11-14T06:18:40.778ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b52cc325-34dc-4391-8b80-9ae50467c453, dataset_name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12162024-11-14T06:18:40.778ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b52cc325-34dc-4391-8b80-9ae50467c453, dataset_name: DatasetName { pool_name: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, kind: Crucible }, responder: ... }
12172024-11-14T06:18:40.813ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 418d13cd-013b-4e47-9c44-69a57b40c042, dataset_name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12182024-11-14T06:18:40.813ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 418d13cd-013b-4e47-9c44-69a57b40c042, dataset_name: DatasetName { pool_name: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, kind: Crucible }, responder: ... }
12192024-11-14T06:18:40.847ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d97bbf94-0186-468c-a542-ed182541bef2, dataset_name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12202024-11-14T06:18:40.847ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d97bbf94-0186-468c-a542-ed182541bef2, dataset_name: DatasetName { pool_name: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, kind: Crucible }, responder: ... }
12212024-11-14T06:18:40.863ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56137
12222024-11-14T06:18:40.864ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56137 req_id = 84276af6-008e-4742-b324-af3d9207dc3c response_code = 200 uri = /baseboard
12232024-11-14T06:18:40.880ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 07eee81c-c4ad-4764-babe-66f1734ebdce, dataset_name: DatasetName { pool_name: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12242024-11-14T06:18:40.880ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 07eee81c-c4ad-4764-babe-66f1734ebdce, dataset_name: DatasetName { pool_name: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, kind: Crucible }, responder: ... }
12252024-11-14T06:18:40.922ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 480cc693-886b-4838-8e35-cffc144aaf19, dataset_name: DatasetName { pool_name: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12262024-11-14T06:18:40.922ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 480cc693-886b-4838-8e35-cffc144aaf19, dataset_name: DatasetName { pool_name: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, kind: Crucible }, responder: ... }
12272024-11-14T06:18:40.963ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c9292d07-2415-41f8-8318-f13ebb88715e, dataset_name: DatasetName { pool_name: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12282024-11-14T06:18:40.963ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c9292d07-2415-41f8-8318-f13ebb88715e, dataset_name: DatasetName { pool_name: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, kind: Crucible }, responder: ... }
12292024-11-14T06:18:41.010ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 49a97aee-3d60-47c5-a5e1-f267ac53c8d5, dataset_name: DatasetName { pool_name: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12302024-11-14T06:18:41.010ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 49a97aee-3d60-47c5-a5e1-f267ac53c8d5, dataset_name: DatasetName { pool_name: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, kind: Crucible }, responder: ... }
12312024-11-14T06:18:41.061ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12322024-11-14T06:18:41.061ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/omicron-zones.json file = common/src/ledger.rs:177
12332024-11-14T06:18:41.061ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/omicron-zones.json file = common/src/ledger.rs:177
12342024-11-14T06:18:41.061ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12352024-11-14T06:18:41.203ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12362024-11-14T06:18:41.281ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12372024-11-14T06:18:41.281ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12382024-11-14T06:18:41.281ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12392024-11-14T06:18:41.281ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12402024-11-14T06:18:41.281ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12412024-11-14T06:18:41.281ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12422024-11-14T06:18:41.281ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12432024-11-14T06:18:41.284ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12442024-11-14T06:18:41.284ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12452024-11-14T06:18:41.477ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12462024-11-14T06:18:41.478ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12472024-11-14T06:18:41.478ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12482024-11-14T06:18:41.478ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12492024-11-14T06:18:41.503ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12502024-11-14T06:18:41.504ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12512024-11-14T06:18:41.504ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12522024-11-14T06:18:41.529ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12532024-11-14T06:18:41.529ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12542024-11-14T06:18:41.529ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce file = illumos-utils/src/zone.rs:325
12552024-11-14T06:18:41.535ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e file = illumos-utils/src/zone.rs:325
12562024-11-14T06:18:41.540ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb file = illumos-utils/src/zone.rs:325
12572024-11-14T06:18:41.545ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b file = illumos-utils/src/zone.rs:325
12582024-11-14T06:18:41.550ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453 file = illumos-utils/src/zone.rs:325
12592024-11-14T06:18:41.555ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042 file = illumos-utils/src/zone.rs:325
12602024-11-14T06:18:41.560ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = illumos-utils/src/zone.rs:325
12612024-11-14T06:18:41.703ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce file = illumos-utils/src/zone.rs:363
12622024-11-14T06:18:41.708ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e file = illumos-utils/src/zone.rs:363
12632024-11-14T06:18:41.713ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb file = illumos-utils/src/zone.rs:363
12642024-11-14T06:18:41.717ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b file = illumos-utils/src/zone.rs:363
12652024-11-14T06:18:41.721ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453 file = illumos-utils/src/zone.rs:363
12662024-11-14T06:18:41.726ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042 file = illumos-utils/src/zone.rs:363
12672024-11-14T06:18:41.731ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = illumos-utils/src/zone.rs:363
12682024-11-14T06:18:41.738ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3 file = illumos-utils/src/zone.rs:325
12692024-11-14T06:18:41.743ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a file = illumos-utils/src/zone.rs:325
12702024-11-14T06:18:41.748ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5 file = illumos-utils/src/zone.rs:325
12712024-11-14T06:18:41.756ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2 file = illumos-utils/src/zone.rs:325
12722024-11-14T06:18:41.761ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959 file = illumos-utils/src/zone.rs:325
12732024-11-14T06:18:41.767ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19 file = illumos-utils/src/zone.rs:325
12742024-11-14T06:18:41.773ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5 file = illumos-utils/src/zone.rs:325
12752024-11-14T06:18:41.834ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12762024-11-14T06:18:41.835ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3 file = illumos-utils/src/zone.rs:363
12772024-11-14T06:18:41.843ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a file = illumos-utils/src/zone.rs:363
12782024-11-14T06:18:41.851ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5 file = illumos-utils/src/zone.rs:363
12792024-11-14T06:18:41.861ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2 file = illumos-utils/src/zone.rs:363
12802024-11-14T06:18:41.877ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959 file = illumos-utils/src/zone.rs:363
12812024-11-14T06:18:41.888ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19 file = illumos-utils/src/zone.rs:363
12822024-11-14T06:18:41.900ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5 file = illumos-utils/src/zone.rs:363
12832024-11-14T06:18:41.974ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12842024-11-14T06:18:42.071ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12852024-11-14T06:18:42.198ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12862024-11-14T06:18:42.272ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12872024-11-14T06:18:42.275ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12882024-11-14T06:18:42.275ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12892024-11-14T06:18:42.332ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 151, 243]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12902024-11-14T06:18:42.332ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12912024-11-14T06:18:42.335ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12922024-11-14T06:18:42.335ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12932024-11-14T06:18:42.391ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 214, 194]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12942024-11-14T06:18:42.391ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12952024-11-14T06:18:42.392ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12962024-11-14T06:18:42.392ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12972024-11-14T06:18:42.450ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 158, 88]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12982024-11-14T06:18:42.450ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12992024-11-14T06:18:42.452ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13002024-11-14T06:18:42.452ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13012024-11-14T06:18:42.510ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 204, 191]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13022024-11-14T06:18:42.510ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
13032024-11-14T06:18:42.513ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13042024-11-14T06:18:42.513ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13052024-11-14T06:18:42.572ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 148, 136]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13062024-11-14T06:18:42.572ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
13072024-11-14T06:18:42.572ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
13082024-11-14T06:18:42.572ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
13092024-11-14T06:18:42.572ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
13102024-11-14T06:18:42.572ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
13112024-11-14T06:18:42.572ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
13122024-11-14T06:18:42.572ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
13132024-11-14T06:18:42.572ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
13142024-11-14T06:18:42.572ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
13152024-11-14T06:18:42.573ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
13162024-11-14T06:18:42.576ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13172024-11-14T06:18:42.627ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
13182024-11-14T06:18:42.634ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
13192024-11-14T06:18:42.634ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13202024-11-14T06:18:42.638ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
13212024-11-14T06:18:42.638ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13222024-11-14T06:18:42.641ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
13232024-11-14T06:18:42.641ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
13242024-11-14T06:18:42.641ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13252024-11-14T06:18:42.795ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
13262024-11-14T06:18:42.798ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13272024-11-14T06:18:42.798ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed file = illumos-utils/src/zone.rs:325
13282024-11-14T06:18:42.810ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16 file = illumos-utils/src/zone.rs:325
13292024-11-14T06:18:42.817ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6 file = illumos-utils/src/zone.rs:325
13302024-11-14T06:18:42.825ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a file = illumos-utils/src/zone.rs:325
13312024-11-14T06:18:42.877ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed file = illumos-utils/src/zone.rs:363
13322024-11-14T06:18:42.885ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16 file = illumos-utils/src/zone.rs:363
13332024-11-14T06:18:42.893ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6 file = illumos-utils/src/zone.rs:363
13342024-11-14T06:18:42.901ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a file = illumos-utils/src/zone.rs:363
13352024-11-14T06:18:42.913ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa file = illumos-utils/src/zone.rs:325
13362024-11-14T06:18:42.941ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa file = illumos-utils/src/zone.rs:363
13372024-11-14T06:18:52.735ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13382024-11-14T06:18:52.737ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
13392024-11-14T06:18:54.292ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='12e2fc66-e201-487e-99d4-64b4b01ac266'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13402024-11-14T06:18:54.294ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4ce86c2f-d73a-421e-8735-58bc8979e498/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='84432233-5a6c-4f27-8871-1b5f966fb84d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13412024-11-14T06:18:54.295ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_93a2b028-0235-4af9-913d-cd3caeb886d5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='67eab654-ee17-41b0-8505-1428f7450a07'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13422024-11-14T06:18:54.295ZINFOSledAgent (ServiceManager): Booting oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
13432024-11-14T06:18:54.314ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f646075d-cd6a-4b0d-98fd-e9fa58aeca6a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13442024-11-14T06:18:54.315ZINFOSledAgent (ServiceManager): Booting oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
13452024-11-14T06:18:54.322ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3687329d-db08-4cdf-99f1-652e017f6592/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='95391253-4058-4da6-97fd-b951f2ecd601'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13462024-11-14T06:18:54.322ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a4fed07d-7b0e-4682-a8fd-598cb8264e7a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13472024-11-14T06:18:54.323ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1d8324ad-f90a-4a01-8aa7-1a5ece516a7f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13482024-11-14T06:18:54.323ZINFOSledAgent (ServiceManager): Booting oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
13492024-11-14T06:18:54.355ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='80417a73-0edf-45d7-9a01-c01e08afefd1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13502024-11-14T06:18:54.355ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
13512024-11-14T06:18:54.363ZINFOSledAgent (ServiceManager): Booting oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
13522024-11-14T06:18:54.369ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
13532024-11-14T06:18:54.376ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
13542024-11-14T06:18:54.382ZINFOSledAgent (ServiceManager): Booting oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
13552024-11-14T06:18:54.983ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13562024-11-14T06:18:54.984ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
13572024-11-14T06:18:54.999ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13582024-11-14T06:18:54.999ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
13592024-11-14T06:18:55.025ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13602024-11-14T06:18:55.025ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
13612024-11-14T06:18:55.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 52.583163ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
13622024-11-14T06:18:55.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 55.471203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
13632024-11-14T06:18:55.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 30.506026ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
13642024-11-14T06:18:55.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 46.428097ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
13652024-11-14T06:18:55.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 56.835162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
13662024-11-14T06:18:55.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 54.92367ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
13672024-11-14T06:18:55.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 26.962947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
13682024-11-14T06:18:55.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 44.823548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
13692024-11-14T06:18:55.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 48.003769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
13702024-11-14T06:18:55.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 136.329388ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
13712024-11-14T06:18:55.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 129.117812ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
13722024-11-14T06:18:55.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 122.194775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
13732024-11-14T06:18:55.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 136.404711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
13742024-11-14T06:18:55.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 146.418084ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
13752024-11-14T06:18:55.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 144.010899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
13762024-11-14T06:18:55.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 67.819693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
13772024-11-14T06:18:55.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 72.633397ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
13782024-11-14T06:18:55.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 74.551798ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
13792024-11-14T06:18:55.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 58.375956ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
13802024-11-14T06:18:55.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 54.701079ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
13812024-11-14T06:18:55.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 32.44094ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
13822024-11-14T06:18:55.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 275.867145ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
13832024-11-14T06:18:55.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 168.589712ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
13842024-11-14T06:18:55.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 102.995183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
13852024-11-14T06:18:55.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 243.25252ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
13862024-11-14T06:18:55.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 94.518046ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
13872024-11-14T06:18:55.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 212.37001ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
13882024-11-14T06:18:55.440ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_195bff2e-21e5-469e-88de-7266b55e8b12/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='755f3815-4159-4dc6-bd3d-b4906a73e850'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13892024-11-14T06:18:55.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 248.018844ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
13902024-11-14T06:18:55.454ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13912024-11-14T06:18:55.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 288.900107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
13922024-11-14T06:18:55.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 275.309736ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
13932024-11-14T06:18:55.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 105.561331ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
13942024-11-14T06:18:55.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 149.835164ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
13952024-11-14T06:18:55.946ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13962024-11-14T06:18:55.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 282.714234ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
13972024-11-14T06:18:56.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 315.544511ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
13982024-11-14T06:18:56.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 294.067863ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
13992024-11-14T06:18:56.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 389.028304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
14002024-11-14T06:18:56.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 547.614944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
14012024-11-14T06:18:56.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 265.771836ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
14022024-11-14T06:18:56.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 414.991181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
14032024-11-14T06:18:56.232ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
14042024-11-14T06:18:56.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 538.984751ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
14052024-11-14T06:18:56.279ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
14062024-11-14T06:18:56.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 429.615554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
14072024-11-14T06:18:56.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 388.352537ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
14082024-11-14T06:18:56.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 124.029116ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
14092024-11-14T06:18:56.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 134.08986ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
14102024-11-14T06:18:56.354ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
14112024-11-14T06:18:56.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 292.666402ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
14122024-11-14T06:18:56.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 1.19691955s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
14132024-11-14T06:18:56.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 407.410892ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
14142024-11-14T06:18:56.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 262.404792ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
14152024-11-14T06:18:56.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 573.688706ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
14162024-11-14T06:18:56.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 471.430991ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
14172024-11-14T06:18:56.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 449.180057ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
14182024-11-14T06:18:56.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 65.972999ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
14192024-11-14T06:18:56.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 562.015401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
14202024-11-14T06:18:56.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 1.188618399s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
14212024-11-14T06:18:56.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 855.408326ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
14222024-11-14T06:18:56.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 80.904282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
14232024-11-14T06:18:56.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 611.708614ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
14242024-11-14T06:18:56.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 1.194805648s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
14252024-11-14T06:18:56.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 997.58429ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
14262024-11-14T06:18:56.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 140.602079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
14272024-11-14T06:18:56.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 973.646849ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
14282024-11-14T06:18:56.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 1.440365503s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
14292024-11-14T06:18:56.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 521.512007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
14302024-11-14T06:18:57.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 918.520924ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
14312024-11-14T06:18:57.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 26.44876ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
14322024-11-14T06:18:57.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 844.227135ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
14332024-11-14T06:18:57.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 76.405399ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
14342024-11-14T06:18:57.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 1.012431857s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
14352024-11-14T06:18:57.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 260.181335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
14362024-11-14T06:18:57.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 27.569398ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
14372024-11-14T06:18:57.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 125.505646ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
14382024-11-14T06:18:57.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 837.507883ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
14392024-11-14T06:18:57.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 165.544728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
14402024-11-14T06:18:57.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 931.894733ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
14412024-11-14T06:18:57.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 328.331882ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
14422024-11-14T06:18:57.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 1.075752484s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
14432024-11-14T06:18:57.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 1.165752922s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
14442024-11-14T06:18:57.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 446.25121ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
14452024-11-14T06:18:57.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 714.149909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
14462024-11-14T06:18:57.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 809.655321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
14472024-11-14T06:18:57.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 1.466364955s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
14482024-11-14T06:18:57.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 1.434664935s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
14492024-11-14T06:18:57.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 1.395820848s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
14502024-11-14T06:18:57.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 540.482209ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
14512024-11-14T06:18:57.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 716.804233ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
14522024-11-14T06:18:58.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 753.051265ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
14532024-11-14T06:18:58.002ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14542024-11-14T06:18:58.002ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14552024-11-14T06:18:58.002ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14562024-11-14T06:18:58.003ZINFOSledAgent (ServiceManager): Booting oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
14572024-11-14T06:18:58.009ZINFOSledAgent (ServiceManager): Booting oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
14582024-11-14T06:18:58.015ZINFOSledAgent (ServiceManager): Booting oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
14592024-11-14T06:18:58.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 1.071630898s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
14602024-11-14T06:18:58.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 1.104367936s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
14612024-11-14T06:18:58.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 847.019494ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
14622024-11-14T06:18:58.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 49.289317ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
14632024-11-14T06:18:58.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 25.290984ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
14642024-11-14T06:18:58.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 46.773492ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
14652024-11-14T06:18:58.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 121.206647ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
14662024-11-14T06:18:58.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 934.66925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
14672024-11-14T06:18:58.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 54.022243ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
14682024-11-14T06:18:58.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 1.083622422s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
14692024-11-14T06:18:58.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 130.950601ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
14702024-11-14T06:18:58.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 720.396505ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
14712024-11-14T06:18:58.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 223.391489ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
14722024-11-14T06:18:58.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 165.181457ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
14732024-11-14T06:18:58.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 255.876049ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
14742024-11-14T06:18:58.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 919.09784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
14752024-11-14T06:18:58.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 780.7948ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
14762024-11-14T06:18:58.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 514.430371ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
14772024-11-14T06:18:58.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 247.760496ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
14782024-11-14T06:18:58.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 1.428852652s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
14792024-11-14T06:18:58.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 970.547036ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
14802024-11-14T06:18:58.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 467.473088ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
14812024-11-14T06:18:58.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 1.316644302s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
14822024-11-14T06:18:58.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 667.442186ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
14832024-11-14T06:18:58.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 1.055706055s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
14842024-11-14T06:18:58.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 1.487333523s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
14852024-11-14T06:18:59.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 1.230037787s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
14862024-11-14T06:18:59.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 441.947376ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
14872024-11-14T06:18:59.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 1.404887481s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
14882024-11-14T06:18:59.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 644.679387ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
14892024-11-14T06:18:59.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 755.268414ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
14902024-11-14T06:18:59.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 1.496743001s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
14912024-11-14T06:18:59.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 1.012221948s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
14922024-11-14T06:18:59.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 808.78157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
14932024-11-14T06:18:59.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 682.517514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
14942024-11-14T06:18:59.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 862.869958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
14952024-11-14T06:18:59.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 567.219348ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
14962024-11-14T06:18:59.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 1.129439346s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
14972024-11-14T06:18:59.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 1.41309218s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
14982024-11-14T06:18:59.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 962.662767ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
14992024-11-14T06:18:59.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 876.19972ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
15002024-11-14T06:18:59.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 713.157957ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
15012024-11-14T06:18:59.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 1.289268618s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
15022024-11-14T06:19:00.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 1.472620359s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
15032024-11-14T06:19:00.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 1.188449435s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
15042024-11-14T06:19:00.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 877.647072ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
15052024-11-14T06:19:00.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 1.479671796s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
15062024-11-14T06:19:00.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 1.134116615s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
15072024-11-14T06:19:00.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 1.377737996s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
15082024-11-14T06:19:00.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 524.993185ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
15092024-11-14T06:19:00.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 575.669084ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
15102024-11-14T06:19:00.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 1.421778069s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
15112024-11-14T06:19:00.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 1.446200743s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
15122024-11-14T06:19:00.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 1.332474105s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
15132024-11-14T06:19:00.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 890.214101ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
15142024-11-14T06:19:00.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 604.976731ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
15152024-11-14T06:19:00.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 1.184151891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
15162024-11-14T06:19:00.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 1.342851053s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
15172024-11-14T06:19:00.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 768.639769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
15182024-11-14T06:19:00.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 1.039286442s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
15192024-11-14T06:19:00.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 511.319272ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
15202024-11-14T06:19:00.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 1.479178811s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
15212024-11-14T06:19:00.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 1.407199385s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
15222024-11-14T06:19:01.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 1.243333366s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
15232024-11-14T06:19:01.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 981.327568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
15242024-11-14T06:19:01.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 749.44862ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
15252024-11-14T06:19:01.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 1.124494224s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
15262024-11-14T06:19:01.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 1.013503094s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
15272024-11-14T06:19:01.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 1.203686448s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
15282024-11-14T06:19:01.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 969.311101ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
15292024-11-14T06:19:01.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 788.820832ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
15302024-11-14T06:19:01.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 787.978105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
15312024-11-14T06:19:01.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 1.46544122s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
15322024-11-14T06:19:01.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 932.55752ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
15332024-11-14T06:19:01.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 573.6551ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
15342024-11-14T06:19:01.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 1.138266981s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
15352024-11-14T06:19:01.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 754.428038ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
15362024-11-14T06:19:01.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 1.466377394s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
15372024-11-14T06:19:01.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 1.377367954s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
15382024-11-14T06:19:02.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 1.156458723s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
15392024-11-14T06:19:02.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 1.043391655s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
15402024-11-14T06:19:02.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 747.443124ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
15412024-11-14T06:19:02.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 1.101576822s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
15422024-11-14T06:19:02.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 826.419268ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
15432024-11-14T06:19:02.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 1.244370999s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
15442024-11-14T06:19:02.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 622.878162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
15452024-11-14T06:19:02.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 1.398450043s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
15462024-11-14T06:19:02.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 1.390899087s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
15472024-11-14T06:19:02.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 539.708303ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
15482024-11-14T06:19:02.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 1.437054359s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
15492024-11-14T06:19:02.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 596.719744ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
15502024-11-14T06:19:02.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 1.221752626s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
15512024-11-14T06:19:02.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 623.515024ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
15522024-11-14T06:19:02.993ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15532024-11-14T06:19:03.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 532.830364ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
15542024-11-14T06:19:03.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 1.01788812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
15552024-11-14T06:19:03.053ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
15562024-11-14T06:19:03.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 1.38234202s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
15572024-11-14T06:19:03.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 878.832239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
15582024-11-14T06:19:03.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 956.39021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
15592024-11-14T06:19:03.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 1.044736736s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
15602024-11-14T06:19:03.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 552.077215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
15612024-11-14T06:19:03.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 1.005285955s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
15622024-11-14T06:19:03.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 708.154348ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
15632024-11-14T06:19:03.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 1.117864903s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
15642024-11-14T06:19:03.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 979.877103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
15652024-11-14T06:19:03.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 506.099721ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
15662024-11-14T06:19:03.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 1.453811963s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
15672024-11-14T06:19:03.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 862.67382ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
15682024-11-14T06:19:03.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 35.938074ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
15692024-11-14T06:19:03.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 1.402649183s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
15702024-11-14T06:19:03.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 98.060615ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
15712024-11-14T06:19:03.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 1.072052462s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
15722024-11-14T06:19:03.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 260.082241ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
15732024-11-14T06:19:03.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 1.161013893s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
15742024-11-14T06:19:03.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 1.298105463s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
15752024-11-14T06:19:03.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 1.293214371s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
15762024-11-14T06:19:03.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 668.605498ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
15772024-11-14T06:19:03.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 805.044143ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
15782024-11-14T06:19:03.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 509.98317ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
15792024-11-14T06:19:04.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 1.240678508s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
15802024-11-14T06:19:04.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 1.008867699s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
15812024-11-14T06:19:04.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 260.906912ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
15822024-11-14T06:19:04.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 528.805954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
15832024-11-14T06:19:04.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 1.155376529s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
15842024-11-14T06:19:04.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 759.785745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
15852024-11-14T06:19:04.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 526.364306ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
15862024-11-14T06:19:04.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 560.209952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
15872024-11-14T06:19:04.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 807.378277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
15882024-11-14T06:19:04.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 1.018185918s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
15892024-11-14T06:19:04.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 1.003104889s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
15902024-11-14T06:19:04.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 1.443225313s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
15912024-11-14T06:19:04.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 657.44237ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
15922024-11-14T06:19:04.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 946.866575ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
15932024-11-14T06:19:04.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 709.292635ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
15942024-11-14T06:19:04.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 1.219017566s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
15952024-11-14T06:19:04.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 890.680703ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
15962024-11-14T06:19:04.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 1.343664449s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
15972024-11-14T06:19:04.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 1.430468847s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
15982024-11-14T06:19:05.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 530.897346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
15992024-11-14T06:19:05.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 1.189557918s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
16002024-11-14T06:19:05.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 1.137240501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
16012024-11-14T06:19:05.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 646.76061ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
16022024-11-14T06:19:05.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 1.340491893s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
16032024-11-14T06:19:05.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 1.122558477s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
16042024-11-14T06:19:05.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 853.861926ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
16052024-11-14T06:19:05.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 1.037531817s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
16062024-11-14T06:19:05.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 833.415341ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
16072024-11-14T06:19:05.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 1.378626123s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
16082024-11-14T06:19:05.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 976.891498ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
16092024-11-14T06:19:05.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 1.430556747s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
16102024-11-14T06:19:05.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 1.266039738s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
16112024-11-14T06:19:05.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 857.109218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
16122024-11-14T06:19:05.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 709.498008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
16132024-11-14T06:19:05.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 1.399016729s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
16142024-11-14T06:19:05.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 1.434021903s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
16152024-11-14T06:19:05.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 1.236949639s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
16162024-11-14T06:19:06.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 564.573394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
16172024-11-14T06:19:06.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 1.10204384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
16182024-11-14T06:19:06.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 1.295251629s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
16192024-11-14T06:19:06.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 611.746399ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
16202024-11-14T06:19:06.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 1.03487137s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
16212024-11-14T06:19:06.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 514.571526ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
16222024-11-14T06:19:06.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 512.624149ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
16232024-11-14T06:19:06.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 828.231041ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
16242024-11-14T06:19:06.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 1.447755382s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
16252024-11-14T06:19:06.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 1.240185568s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
16262024-11-14T06:19:06.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 544.542592ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
16272024-11-14T06:19:06.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 1.46712464s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
16282024-11-14T06:19:06.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 1.079073994s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
16292024-11-14T06:19:06.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 1.083023577s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
16302024-11-14T06:19:06.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 763.961197ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
16312024-11-14T06:19:06.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 1.248551965s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
16322024-11-14T06:19:06.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 560.273151ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
16332024-11-14T06:19:06.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 708.63067ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
16342024-11-14T06:19:06.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 823.013464ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
16352024-11-14T06:19:06.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 626.717378ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
16362024-11-14T06:19:06.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 1.022106187s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
16372024-11-14T06:19:07.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 611.218019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
16382024-11-14T06:19:07.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 1.493999667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
16392024-11-14T06:19:07.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 985.451824ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
16402024-11-14T06:19:07.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 571.181691ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
16412024-11-14T06:19:07.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 968.482888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
16422024-11-14T06:19:07.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 1.366606628s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
16432024-11-14T06:19:07.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 562.002113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
16442024-11-14T06:19:07.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 1.033127795s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
16452024-11-14T06:19:07.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 1.41038218s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
16462024-11-14T06:19:07.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 1.499680465s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
16472024-11-14T06:19:07.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 637.580681ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
16482024-11-14T06:19:07.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 1.111430918s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
16492024-11-14T06:19:07.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 1.457315596s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
16502024-11-14T06:19:07.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 641.627532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
16512024-11-14T06:19:07.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 784.831312ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
16522024-11-14T06:19:07.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 1.165996504s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
16532024-11-14T06:19:07.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 809.443395ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
16542024-11-14T06:19:07.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 528.425253ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
16552024-11-14T06:19:07.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 923.988184ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
16562024-11-14T06:19:07.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 577.853922ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
16572024-11-14T06:19:07.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 1.066087111s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
16582024-11-14T06:19:08.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 1.283735296s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
16592024-11-14T06:19:08.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 1.474477105s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
16602024-11-14T06:19:08.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 704.908915ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
16612024-11-14T06:19:08.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 747.911296ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
16622024-11-14T06:19:08.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 678.300715ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
16632024-11-14T06:19:08.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 761.623741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
16642024-11-14T06:19:08.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 566.418657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
16652024-11-14T06:19:08.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 1.440005668s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
16662024-11-14T06:19:08.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 1.329363028s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
16672024-11-14T06:19:08.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 596.988802ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
16682024-11-14T06:19:08.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 639.804153ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
16692024-11-14T06:19:08.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 707.130259ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
16702024-11-14T06:19:08.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 538.632549ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
16712024-11-14T06:19:08.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 1.404078685s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
16722024-11-14T06:19:08.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 1.186525537s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
16732024-11-14T06:19:08.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 1.281441957s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
16742024-11-14T06:19:08.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 1.216426822s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
16752024-11-14T06:19:08.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 908.785979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
16762024-11-14T06:19:09.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 1.226886244s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
16772024-11-14T06:19:09.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 716.91196ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
16782024-11-14T06:19:09.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 715.47754ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
16792024-11-14T06:19:09.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 702.249328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
16802024-11-14T06:19:09.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 832.74086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
16812024-11-14T06:19:09.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 749.345071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
16822024-11-14T06:19:09.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 1.345982703s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
16832024-11-14T06:19:09.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 607.624528ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
16842024-11-14T06:19:09.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 611.596162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
16852024-11-14T06:19:09.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 889.0994ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
16862024-11-14T06:19:09.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 1.177315931s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
16872024-11-14T06:19:09.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 853.975253ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
16882024-11-14T06:19:09.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 1.411091439s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
16892024-11-14T06:19:09.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 1.370675569s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
16902024-11-14T06:19:09.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 969.913699ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
16912024-11-14T06:19:09.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 567.543586ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
16922024-11-14T06:19:09.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 697.2001ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
16932024-11-14T06:19:09.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 1.259385672s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
16942024-11-14T06:19:09.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 1.480935701s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
16952024-11-14T06:19:09.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 1.142904847s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
16962024-11-14T06:19:09.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 816.788923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
16972024-11-14T06:19:10.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 1.275400156s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
16982024-11-14T06:19:10.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 1.432610823s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
16992024-11-14T06:19:10.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 832.228179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
17002024-11-14T06:19:10.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 1.392437734s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
17012024-11-14T06:19:10.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 988.827356ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
17022024-11-14T06:19:10.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 852.876693ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
17032024-11-14T06:19:10.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 965.944844ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
17042024-11-14T06:19:10.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 1.344811721s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
17052024-11-14T06:19:10.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 1.110298078s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
17062024-11-14T06:19:10.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 965.288721ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
17072024-11-14T06:19:10.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 1.066919254s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
17082024-11-14T06:19:10.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 730.880519ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
17092024-11-14T06:19:10.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 1.051300318s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
17102024-11-14T06:19:10.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 1.377369802s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
17112024-11-14T06:19:10.952ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53344
17122024-11-14T06:19:10.957ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53344 req_id = b1ad1dc9-67e0-4fe9-8c84-4f344325ea8f response_code = 200 uri = /baseboard
17132024-11-14T06:19:11.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 745.170371ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
17142024-11-14T06:19:11.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 1.083905255s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
17152024-11-14T06:19:11.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 1.359708016s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
17162024-11-14T06:19:11.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 1.193477134s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
17172024-11-14T06:19:11.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 1.109848913s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
17182024-11-14T06:19:11.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 1.032495307s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
17192024-11-14T06:19:11.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 976.969158ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
17202024-11-14T06:19:11.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 536.40711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
17212024-11-14T06:19:11.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 1.482595681s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
17222024-11-14T06:19:11.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 691.714507ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
17232024-11-14T06:19:11.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 1.010370873s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
17242024-11-14T06:19:11.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 1.209815232s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
17252024-11-14T06:19:11.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 751.063066ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
17262024-11-14T06:19:11.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 707.388287ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
17272024-11-14T06:19:11.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 1.220734055s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
17282024-11-14T06:19:11.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 1.049074779s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
17292024-11-14T06:19:11.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 1.248686765s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
17302024-11-14T06:19:11.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 933.522255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
17312024-11-14T06:19:11.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 663.015727ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
17322024-11-14T06:19:11.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 1.241224033s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
17332024-11-14T06:19:12.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 609.463219ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
17342024-11-14T06:19:12.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 781.192621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
17352024-11-14T06:19:12.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 900.500893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
17362024-11-14T06:19:12.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 802.57444ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
17372024-11-14T06:19:12.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 792.376381ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
17382024-11-14T06:19:12.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 1.041701965s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
17392024-11-14T06:19:12.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 632.182531ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
17402024-11-14T06:19:12.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 794.042094ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
17412024-11-14T06:19:12.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 870.949015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
17422024-11-14T06:19:12.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 1.304348724s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
17432024-11-14T06:19:12.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 531.65785ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
17442024-11-14T06:19:12.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 695.415823ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
17452024-11-14T06:19:12.582ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 182.199916668s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
17462024-11-14T06:19:12.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 1.09183779s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
17472024-11-14T06:19:12.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 1.12544413s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
17482024-11-14T06:19:12.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 630.331456ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
17492024-11-14T06:19:12.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 1.397124895s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
17502024-11-14T06:19:12.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 921.418032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
17512024-11-14T06:19:12.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 748.803541ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
17522024-11-14T06:19:12.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 1.433017661s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
17532024-11-14T06:19:13.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 817.599251ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
17542024-11-14T06:19:13.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 660.819611ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
17552024-11-14T06:19:13.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 1.480558522s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
17562024-11-14T06:19:13.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 1.053701725s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
17572024-11-14T06:19:13.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 860.626331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
17582024-11-14T06:19:13.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 625.885268ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
17592024-11-14T06:19:13.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 817.173568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
17602024-11-14T06:19:13.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 520.926419ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
17612024-11-14T06:19:13.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 552.378476ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
17622024-11-14T06:19:13.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 644.627041ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
17632024-11-14T06:19:13.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 765.323533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
17642024-11-14T06:19:13.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 593.967788ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
17652024-11-14T06:19:13.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 1.379197734s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
17662024-11-14T06:19:13.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 717.102322ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
17672024-11-14T06:19:13.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 1.234211803s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
17682024-11-14T06:19:13.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 1.069030051s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
17692024-11-14T06:19:13.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 742.800402ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
17702024-11-14T06:19:13.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 952.016974ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
17712024-11-14T06:19:13.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 1.252833612s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
17722024-11-14T06:19:13.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 912.962182ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
17732024-11-14T06:19:13.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 858.3125ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
17742024-11-14T06:19:13.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 1.228990714s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
17752024-11-14T06:19:13.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 513.590236ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
17762024-11-14T06:19:13.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 1.222483228s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
17772024-11-14T06:19:13.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 1.44968058s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
17782024-11-14T06:19:14.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 1.19605841s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
17792024-11-14T06:19:14.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 1.193233206s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
17802024-11-14T06:19:14.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 1.045274911s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
17812024-11-14T06:19:14.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 1.114630172s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
17822024-11-14T06:19:14.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 792.336292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
17832024-11-14T06:19:14.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 685.200292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
17842024-11-14T06:19:14.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 1.426765999s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
17852024-11-14T06:19:14.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 858.550485ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
17862024-11-14T06:19:14.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 896.382499ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
17872024-11-14T06:19:14.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 939.048754ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
17882024-11-14T06:19:14.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 878.260589ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
17892024-11-14T06:19:14.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 833.709233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
17902024-11-14T06:19:14.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 1.326379987s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
17912024-11-14T06:19:14.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 1.187903289s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
17922024-11-14T06:19:15.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 551.456657ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
17932024-11-14T06:19:15.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 540.924965ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
17942024-11-14T06:19:15.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 672.985888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
17952024-11-14T06:19:15.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 1.083885593s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
17962024-11-14T06:19:15.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 586.846342ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
17972024-11-14T06:19:15.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 607.526495ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
17982024-11-14T06:19:15.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 862.058324ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
17992024-11-14T06:19:15.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 1.318284277s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
18002024-11-14T06:19:15.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 1.384410834s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
18012024-11-14T06:19:15.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 848.57833ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
18022024-11-14T06:19:15.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 950.423814ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
18032024-11-14T06:19:15.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 977.012757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
18042024-11-14T06:19:15.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 1.279187673s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
18052024-11-14T06:19:15.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 514.945764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
18062024-11-14T06:19:15.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 1.197789461s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
18072024-11-14T06:19:15.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 636.75003ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
18082024-11-14T06:19:15.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 1.17668066s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
18092024-11-14T06:19:15.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 1.124544031s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
18102024-11-14T06:19:15.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5") failed: Property not found. retry in 1.246911941s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
18112024-11-14T06:19:15.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 886.920953ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
18122024-11-14T06:19:15.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 951.330509ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
18132024-11-14T06:19:15.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 1.47617837s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
18142024-11-14T06:19:16.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 1.161207077s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
18152024-11-14T06:19:16.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 796.064263ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
18162024-11-14T06:19:16.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 1.023717553s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
18172024-11-14T06:19:16.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 803.808499ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
18182024-11-14T06:19:16.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 506.534092ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
18192024-11-14T06:19:16.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 1.097196913s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
18202024-11-14T06:19:16.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 1.081088395s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
18212024-11-14T06:19:16.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 1.087834568s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
18222024-11-14T06:19:16.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 1.409127668s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
18232024-11-14T06:19:16.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 803.03425ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
18242024-11-14T06:19:16.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce") failed: Property not found. retry in 1.363076265s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
18252024-11-14T06:19:16.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19") failed: Property not found. retry in 939.284142ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
18262024-11-14T06:19:16.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 748.652439ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
18272024-11-14T06:19:16.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 1.242591576s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
18282024-11-14T06:19:16.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 613.608585ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
18292024-11-14T06:19:16.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 1.330068121s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
18302024-11-14T06:19:16.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959") failed: Property not found. retry in 1.057885874s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
18312024-11-14T06:19:16.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 1.337261817s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
18322024-11-14T06:19:16.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 890.23902ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
18332024-11-14T06:19:17.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 1.065680619s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
18342024-11-14T06:19:17.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 837.171912ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
18352024-11-14T06:19:17.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 1.345650666s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
18362024-11-14T06:19:17.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 523.470401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
18372024-11-14T06:19:17.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 711.861032ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
18382024-11-14T06:19:17.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 1.348200073s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
18392024-11-14T06:19:17.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 649.605158ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
18402024-11-14T06:19:17.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 1.429330922s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
18412024-11-14T06:19:17.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb") failed: Property not found. retry in 1.37569753s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
18422024-11-14T06:19:17.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 621.367966ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
18432024-11-14T06:19:17.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e") failed: Property not found. retry in 1.058517202s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
18442024-11-14T06:19:17.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 644.903025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
18452024-11-14T06:19:17.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453") failed: Property not found. retry in 1.491442883s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
18462024-11-14T06:19:18.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 731.424406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
18472024-11-14T06:19:18.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 564.828595ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
18482024-11-14T06:19:18.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a") failed: Property not found. retry in 1.163282681s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
18492024-11-14T06:19:18.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a") failed: Property not found. retry in 914.579228ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
18502024-11-14T06:19:18.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16") failed: Property not found. retry in 1.478590302s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
18512024-11-14T06:19:18.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6") failed: Property not found. retry in 1.282380481s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
18522024-11-14T06:19:18.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6") failed: Property not found. retry in 1.056662494s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
18532024-11-14T06:19:18.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2") failed: Property not found. retry in 1.488374761s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
18542024-11-14T06:19:18.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b") failed: Property not found. retry in 845.295602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
18552024-11-14T06:19:18.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa") failed: Property not found. retry in 1.412200598s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
18562024-11-14T06:19:18.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042") failed: Property not found. retry in 912.683274ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
18572024-11-14T06:19:18.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5") failed: Property not found. retry in 1.412305168s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
18582024-11-14T06:19:18.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3") failed: Property not found. retry in 1.287993726s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
18592024-11-14T06:19:18.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed") failed: Property not found. retry in 1.3555584s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
18602024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_f40de7f6-4bc1-4578-baeb-b08e777b4bed
18612024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_07eee81c-c4ad-4764-babe-66f1734ebdce
18622024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_c9292d07-2415-41f8-8318-f13ebb88715e
18632024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_07b31281-03e7-4f70-8104-fdc883991dfb
18642024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_6c36fb69-917c-4de7-bd2a-b235e97df27b
18652024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_b52cc325-34dc-4391-8b80-9ae50467c453
18662024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_418d13cd-013b-4e47-9c44-69a57b40c042
18672024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_720ac48b-8596-4763-a661-482d124c0a16
18682024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6
18692024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_b8f86511-dd51-4fcd-bfdc-8e92264988b6
18702024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_58f1ad07-a6fc-4f37-99d2-d577d50a1ab3
18712024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_bfe850ec-84b4-4416-b7f1-ea945f66d71a
18722024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_a75b84fe-728a-41f6-86dc-489dada09cf5
18732024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_80190dc3-d884-49a0-b9a3-38d31e8c655a
18742024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_d97bbf94-0186-468c-a542-ed182541bef2
18752024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_6f61ac48-36eb-4012-bb75-ab8f788b4959
18762024-11-14T06:19:20.310ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_6e81a29a-9566-4f30-8c2b-046fbbd99dfa
18772024-11-14T06:19:20.313ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_480cc693-886b-4838-8e35-cffc144aaf19
18782024-11-14T06:19:20.313ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_49a97aee-3d60-47c5-a5e1-f267ac53c8d5
18792024-11-14T06:19:20.315ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18802024-11-14T06:19:20.317ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18812024-11-14T06:19:20.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40034566 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39816 req_id = cb94de5b-ed54-4a9a-a484-488a580aa74c response_code = 204 uri = /omicron-zones
18822024-11-14T06:19:20.334ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1446
18832024-11-14T06:19:20.334ZINFOSledAgent (RSS): Writing ledger to /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18842024-11-14T06:19:20.335ZINFOSledAgent (RSS): Writing ledger to /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18852024-11-14T06:19:20.520ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
18862024-11-14T06:19:20.528ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:799
18872024-11-14T06:19:20.579ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1011
18882024-11-14T06:19:22.169ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
18892024-11-14T06:19:22.239ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
18902024-11-14T06:19:22.307ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
18912024-11-14T06:19:22.500ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
18922024-11-14T06:19:22.610ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
18932024-11-14T06:19:22.855ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
18942024-11-14T06:19:23.222ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
18952024-11-14T06:19:23.423ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
18962024-11-14T06:19:23.820ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
18972024-11-14T06:19:24.305ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
18982024-11-14T06:19:24.701ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
18992024-11-14T06:19:25.150ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
19002024-11-14T06:19:26.165ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
19012024-11-14T06:19:27.673ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e26a1fc7-645c-4c87-b8bd-c0b7e3c90a6f", "content-length": "173", "date": "Thu, 14 Nov 2024 06:19:27 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"f391bffc-9f2b-4c87-85cd-2718afa7cb93\"", request_id: "e26a1fc7-645c-4c87-b8bd-c0b7e3c90a6f" } file = sled-agent/src/rack_setup/service.rs:1073
19022024-11-14T06:19:28.636ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
19032024-11-14T06:19:28.991ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b6d5490b-53a4-4ea2-940f-04c0cc167460", "content-length": "173", "date": "Thu, 14 Nov 2024 06:19:28 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"f391bffc-9f2b-4c87-85cd-2718afa7cb93\"", request_id: "b6d5490b-53a4-4ea2-940f-04c0cc167460" } file = sled-agent/src/rack_setup/service.rs:1073
19042024-11-14T06:19:29.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57397
19052024-11-14T06:19:29.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1765 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57397 req_id = e8282efd-8121-4799-9f9e-78270db13f73 response_code = 200 uri = /vpc-routes
19062024-11-14T06:19:29.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41174
19072024-11-14T06:19:29.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41174 req_id = 0cb4aa31-426a-48b7-bfcb-4ef81ad3ec12 response_code = 200 uri = /vpc-routes
19082024-11-14T06:19:29.845ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41848
19092024-11-14T06:19:29.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41848 req_id = 08fc6ad9-9c51-4818-a4ea-3aaadf94ec0f response_code = 200 uri = /vpc-routes
19102024-11-14T06:19:29.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34822
19112024-11-14T06:19:29.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19122024-11-14T06:19:29.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19132024-11-14T06:19:29.890ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/omicron-zones.json file = common/src/ledger.rs:177
19142024-11-14T06:19:29.891ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/omicron-zones.json file = common/src/ledger.rs:177
19152024-11-14T06:19:29.898ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
19162024-11-14T06:19:29.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57397 req_id = 47206514-7193-497b-b33c-ce7ad9b909c6 response_code = 204 uri = /eip-gateways
19172024-11-14T06:19:29.898ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
19182024-11-14T06:19:29.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41174 req_id = 0ba3728a-ba7f-45a6-b0a3-66ef43b2d8da response_code = 204 uri = /eip-gateways
19192024-11-14T06:19:29.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53785
19202024-11-14T06:19:29.903ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19212024-11-14T06:19:29.903ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19222024-11-14T06:19:29.903ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/omicron-zones.json file = common/src/ledger.rs:177
19232024-11-14T06:19:29.903ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/omicron-zones.json file = common/src/ledger.rs:177
19242024-11-14T06:19:29.907ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19252024-11-14T06:19:29.907ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3687329d-db08-4cdf-99f1-652e017f6592
19262024-11-14T06:19:29.913ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
19272024-11-14T06:19:29.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 377 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41848 req_id = 84f35e23-8ffe-493a-9fb5-fc8350591306 response_code = 204 uri = /eip-gateways
19282024-11-14T06:19:29.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46243
19292024-11-14T06:19:29.928ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19302024-11-14T06:19:29.928ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3687329d-db08-4cdf-99f1-652e017f6592
19312024-11-14T06:19:29.947ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19322024-11-14T06:19:29.947ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19332024-11-14T06:19:29.947ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/omicron-zones.json file = common/src/ledger.rs:177
19342024-11-14T06:19:29.956ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/omicron-zones.json file = common/src/ledger.rs:177
19352024-11-14T06:19:29.961ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19362024-11-14T06:19:29.961ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3
19372024-11-14T06:19:29.980ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19382024-11-14T06:19:29.980ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3
19392024-11-14T06:19:29.996ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19402024-11-14T06:19:29.996ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3687329d-db08-4cdf-99f1-652e017f6592
19412024-11-14T06:19:30.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63463
19422024-11-14T06:19:30.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 705 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63463 req_id = 51ea4ba9-fa41-4dad-928c-27074fb4160c response_code = 200 uri = /v2p
19432024-11-14T06:19:30.016ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19442024-11-14T06:19:30.016ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae
19452024-11-14T06:19:30.039ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19462024-11-14T06:19:30.039ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae
19472024-11-14T06:19:30.059ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19482024-11-14T06:19:30.059ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3
19492024-11-14T06:19:30.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44458
19502024-11-14T06:19:30.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43199
19512024-11-14T06:19:30.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43199 req_id = 0321efbb-ea4f-48aa-bbd4-296c7f2cb8f6 response_code = 200 uri = /v2p
19522024-11-14T06:19:30.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44458 req_id = e5e1b9f6-3c9c-4e9f-a654-0236ba9dcc50 response_code = 200 uri = /v2p
19532024-11-14T06:19:30.076ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19542024-11-14T06:19:30.076ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73
19552024-11-14T06:19:30.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19628 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57397 req_id = 56f8e57b-f47d-4b0f-aa60-8558510a253d response_code = 204 uri = /vpc-routes
19562024-11-14T06:19:30.094ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19572024-11-14T06:19:30.094ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73
19582024-11-14T06:19:30.111ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19592024-11-14T06:19:30.121ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae
19602024-11-14T06:19:30.126ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
19612024-11-14T06:19:30.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41848 req_id = 4ff1f65f-0ce6-4ed2-b991-d9ac792ea5ab response_code = 204 uri = /vpc-routes
19622024-11-14T06:19:30.139ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19632024-11-14T06:19:30.139ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374
19642024-11-14T06:19:30.155ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19652024-11-14T06:19:30.155ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374
19662024-11-14T06:19:30.174ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19672024-11-14T06:19:30.174ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73
19682024-11-14T06:19:30.192ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19692024-11-14T06:19:30.192ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4ce86c2f-d73a-421e-8735-58bc8979e498
19702024-11-14T06:19:30.209ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19712024-11-14T06:19:30.209ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4ce86c2f-d73a-421e-8735-58bc8979e498
19722024-11-14T06:19:30.225ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19732024-11-14T06:19:30.225ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374
19742024-11-14T06:19:30.237ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
19752024-11-14T06:19:30.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 510 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41174 req_id = 313fd2dd-4451-43d5-a346-23b1b8f494c5 response_code = 204 uri = /vpc-routes
19762024-11-14T06:19:30.239ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19772024-11-14T06:19:30.239ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_93a2b028-0235-4af9-913d-cd3caeb886d5
19782024-11-14T06:19:30.255ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19792024-11-14T06:19:30.256ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_93a2b028-0235-4af9-913d-cd3caeb886d5
19802024-11-14T06:19:30.272ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19812024-11-14T06:19:30.272ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4ce86c2f-d73a-421e-8735-58bc8979e498
19822024-11-14T06:19:30.283ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19832024-11-14T06:19:30.283ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_195bff2e-21e5-469e-88de-7266b55e8b12
19842024-11-14T06:19:30.295ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19852024-11-14T06:19:30.295ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_195bff2e-21e5-469e-88de-7266b55e8b12
19862024-11-14T06:19:30.308ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19872024-11-14T06:19:30.310ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_93a2b028-0235-4af9-913d-cd3caeb886d5
19882024-11-14T06:19:30.324ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19892024-11-14T06:19:30.324ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f
19902024-11-14T06:19:30.336ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19912024-11-14T06:19:30.336ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f
19922024-11-14T06:19:30.351ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19932024-11-14T06:19:30.351ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_195bff2e-21e5-469e-88de-7266b55e8b12
19942024-11-14T06:19:30.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 466307 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34822 req_id = e21ac068-6546-4dce-b523-8e1f5a4f6d36 response_code = 200 uri = /inventory
19952024-11-14T06:19:30.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 465319 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53785 req_id = 9acf7107-f934-40f3-9400-5b14fb308d0e response_code = 200 uri = /inventory
19962024-11-14T06:19:30.373ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19972024-11-14T06:19:30.373ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f
19982024-11-14T06:19:30.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 460159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46243 req_id = aa1f4652-343c-44f4-86fc-70b51b01edc3 response_code = 200 uri = /inventory
19992024-11-14T06:19:30.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60914
20002024-11-14T06:19:30.984ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
20012024-11-14T06:19:30.984ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
20022024-11-14T06:19:30.984ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/omicron-zones.json file = common/src/ledger.rs:177
20032024-11-14T06:19:30.984ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/omicron-zones.json file = common/src/ledger.rs:177
20042024-11-14T06:19:30.995ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20052024-11-14T06:19:30.996ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3687329d-db08-4cdf-99f1-652e017f6592
20062024-11-14T06:19:31.021ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20072024-11-14T06:19:31.021ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3
20082024-11-14T06:19:31.046ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20092024-11-14T06:19:31.046ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae
20102024-11-14T06:19:31.070ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20112024-11-14T06:19:31.070ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73
20122024-11-14T06:19:31.092ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20132024-11-14T06:19:31.092ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374
20142024-11-14T06:19:31.115ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20152024-11-14T06:19:31.115ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4ce86c2f-d73a-421e-8735-58bc8979e498
20162024-11-14T06:19:31.137ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20172024-11-14T06:19:31.137ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_93a2b028-0235-4af9-913d-cd3caeb886d5
20182024-11-14T06:19:31.159ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20192024-11-14T06:19:31.159ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_195bff2e-21e5-469e-88de-7266b55e8b12
20202024-11-14T06:19:31.186ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20212024-11-14T06:19:31.186ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f
20222024-11-14T06:19:31.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215881 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60914 req_id = 262cca77-e4e9-428d-8fbb-2563b7633b94 response_code = 200 uri = /inventory
20232024-11-14T06:19:31.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54292
20242024-11-14T06:19:31.891ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20252024-11-14T06:19:31.892ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20262024-11-14T06:19:31.892ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20272024-11-14T06:19:31.892ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20282024-11-14T06:19:31.892ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20292024-11-14T06:19:31.892ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20302024-11-14T06:19:31.892ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20312024-11-14T06:19:31.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54292 req_id = 4856aacf-58ee-4717-a086-facfd24b5bd9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20322024-11-14T06:19:31.894ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1083
20332024-11-14T06:19:32.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48022
20342024-11-14T06:19:32.227ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
20352024-11-14T06:19:32.227ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
20362024-11-14T06:19:32.227ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/omicron-zones.json file = common/src/ledger.rs:177
20372024-11-14T06:19:32.228ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/omicron-zones.json file = common/src/ledger.rs:177
20382024-11-14T06:19:32.239ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20392024-11-14T06:19:32.239ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3687329d-db08-4cdf-99f1-652e017f6592
20402024-11-14T06:19:32.263ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20412024-11-14T06:19:32.263ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3
20422024-11-14T06:19:32.285ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20432024-11-14T06:19:32.285ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae
20442024-11-14T06:19:32.307ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20452024-11-14T06:19:32.307ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73
20462024-11-14T06:19:32.329ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20472024-11-14T06:19:32.329ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374
20482024-11-14T06:19:32.352ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20492024-11-14T06:19:32.352ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4ce86c2f-d73a-421e-8735-58bc8979e498
20502024-11-14T06:19:32.376ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20512024-11-14T06:19:32.376ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_93a2b028-0235-4af9-913d-cd3caeb886d5
20522024-11-14T06:19:32.401ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20532024-11-14T06:19:32.401ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_195bff2e-21e5-469e-88de-7266b55e8b12
20542024-11-14T06:19:32.424ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
20552024-11-14T06:19:32.424ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f
20562024-11-14T06:19:32.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210381 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48022 req_id = d0b10e5d-e5b2-4a8e-a362-e540d7937e22 response_code = 200 uri = /inventory
20572024-11-14T06:19:32.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43429
20582024-11-14T06:19:32.987ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20592024-11-14T06:19:32.987ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20602024-11-14T06:19:32.987ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20612024-11-14T06:19:32.987ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20622024-11-14T06:19:32.987ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20632024-11-14T06:19:32.987ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20642024-11-14T06:19:32.987ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20652024-11-14T06:19:32.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43429 req_id = 818c7639-16e1-4b6b-afa6-b7b36ddcacc9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20662024-11-14T06:19:33.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55913
20672024-11-14T06:19:33.227ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20682024-11-14T06:19:33.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20692024-11-14T06:19:33.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20702024-11-14T06:19:33.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20712024-11-14T06:19:33.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20722024-11-14T06:19:33.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20732024-11-14T06:19:33.227ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20742024-11-14T06:19:33.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55913 req_id = 3119b654-1ee5-4d46-a721-89f1c12818e3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20752024-11-14T06:19:33.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36330
20762024-11-14T06:19:33.619ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20772024-11-14T06:19:33.620ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20782024-11-14T06:19:33.620ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20792024-11-14T06:19:33.620ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20802024-11-14T06:19:33.620ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20812024-11-14T06:19:33.620ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20822024-11-14T06:19:33.620ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20832024-11-14T06:19:33.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36330 req_id = 8053e070-7433-49ac-993f-e770abb0b4f5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20842024-11-14T06:19:34.879ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20852024-11-14T06:19:37.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43476
20862024-11-14T06:19:37.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43476 req_id = 277e663b-f56a-4e04-8996-877cd4eca657 response_code = 200 uri = /vpc-routes
20872024-11-14T06:19:37.685ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
20882024-11-14T06:19:37.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43476 req_id = 3c0d08cc-2074-4012-8f24-ad50d072de05 response_code = 204 uri = /eip-gateways
20892024-11-14T06:19:37.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43476 req_id = 8017729e-1a22-49c0-b1ac-9dee846d5c43 response_code = 204 uri = /vpc-routes
20902024-11-14T06:19:40.995ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45379
20912024-11-14T06:19:40.995ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45379 req_id = 3278fba5-4690-4380-8399-281bf7ae126f response_code = 200 uri = /baseboard
20922024-11-14T06:19:59.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57786
20932024-11-14T06:19:59.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57786 req_id = f86b7613-063a-469f-b950-a9bda8517061 response_code = 200 uri = /vpc-routes
20942024-11-14T06:19:59.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52416
20952024-11-14T06:19:59.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52416 req_id = 63cc0c9c-2bdf-4c72-9ea1-78b0c0e58374 response_code = 200 uri = /v2p
20962024-11-14T06:19:59.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64195
20972024-11-14T06:19:59.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64195 req_id = bebabb61-f0bb-4f06-97ce-3ea699f03900 response_code = 200 uri = /vpc-routes
20982024-11-14T06:19:59.733ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
20992024-11-14T06:19:59.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64195 req_id = b66ca5bb-d2ef-492a-a9fd-5c794b9ef36c response_code = 204 uri = /eip-gateways
21002024-11-14T06:19:59.746ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
21012024-11-14T06:19:59.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57786 req_id = 8cc572a9-d881-4a4a-b9fb-e2da9ee5ee83 response_code = 204 uri = /eip-gateways
21022024-11-14T06:19:59.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64195 req_id = 7e13875d-1538-4c9e-8a6e-c66ea14ff858 response_code = 204 uri = /vpc-routes
21032024-11-14T06:19:59.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57786 req_id = 3a6d4df2-c37b-40f6-bb83-de35257dd36a response_code = 204 uri = /vpc-routes
21042024-11-14T06:19:59.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59231
21052024-11-14T06:19:59.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59231 req_id = ad898772-07c1-4c40-8834-f91a378fe5fa response_code = 200 uri = /vpc-routes
21062024-11-14T06:19:59.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40769
21072024-11-14T06:19:59.846ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21082024-11-14T06:19:59.921ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21092024-11-14T06:19:59.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138938 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40769 req_id = 7951d772-f263-49aa-b5dd-6c2ad1f078bb response_code = 204 uri = /switch-ports
21102024-11-14T06:19:59.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45039
21112024-11-14T06:19:59.983ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
21122024-11-14T06:19:59.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59231 req_id = 94b004a9-5300-482f-866d-01cb5b76db46 response_code = 204 uri = /eip-gateways
21132024-11-14T06:19:59.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47329
21142024-11-14T06:19:59.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34462
21152024-11-14T06:19:59.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63090
21162024-11-14T06:19:59.984ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21172024-11-14T06:19:59.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47329 req_id = 09c1ecea-0ed8-4f7c-a2c2-d2eee17c381e response_code = 200 uri = /v2p
21182024-11-14T06:19:59.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7317 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40769 req_id = a5de8392-76e5-4b30-b7c1-782a45142c95 response_code = 200 uri = /network-bootstore-config
21192024-11-14T06:19:59.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7033 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34462 req_id = cddd0cfa-5cde-4f8e-9e59-1b28e7c4fc51 response_code = 200 uri = /v2p
21202024-11-14T06:19:59.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59231 req_id = 638c1379-05f0-4a18-9707-8534858408d9 response_code = 204 uri = /vpc-routes
21212024-11-14T06:20:00.030ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21222024-11-14T06:20:00.085ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21232024-11-14T06:20:00.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101236 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63090 req_id = 1ef2722e-c002-46af-a8b3-f9694d2d1d73 response_code = 204 uri = /switch-ports
21242024-11-14T06:20:00.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63090 req_id = f9d9455b-ca2f-47ce-af68-25cedcb1fc36 response_code = 200 uri = /network-bootstore-config
21252024-11-14T06:20:00.117ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21262024-11-14T06:20:00.126ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
21272024-11-14T06:20:00.126ZINFOSledAgent (bootstore): Writing ledger to /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
21282024-11-14T06:20:00.127ZINFOSledAgent (bootstore): Writing ledger to /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
21292024-11-14T06:20:00.128ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
21302024-11-14T06:20:00.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3667 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40769 req_id = e720b15f-1735-462f-b821-5c6037ecfd0d response_code = 204 uri = /network-bootstore-config
21312024-11-14T06:20:00.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181567 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45039 req_id = db5cc0dd-0056-40f9-83bb-1d9c2ab0b62c response_code = 204 uri = /switch-ports
21322024-11-14T06:20:00.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 731 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45039 req_id = 58a243f7-3af3-41c8-9ac5-d8625d489b98 response_code = 200 uri = /network-bootstore-config
21332024-11-14T06:20:11.030ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43689
21342024-11-14T06:20:11.031ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43689 req_id = bf3b35a6-8f6f-4f8f-9a24-c4f03bcf0db5 response_code = 200 uri = /baseboard
21352024-11-14T06:20:29.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43032
21362024-11-14T06:20:29.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43032 req_id = c5cdf060-4662-4854-b7df-dfe56ece075c response_code = 200 uri = /vpc-routes
21372024-11-14T06:20:29.713ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
21382024-11-14T06:20:29.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43032 req_id = e5aa5c25-c776-4b8c-8125-b2469106f371 response_code = 204 uri = /eip-gateways
21392024-11-14T06:20:29.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41657
21402024-11-14T06:20:29.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41657 req_id = ffea1fec-2d03-41ca-990d-794cdf54d605 response_code = 200 uri = /vpc-routes
21412024-11-14T06:20:29.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43032 req_id = ca51fcdc-306d-46d5-8173-51ada87339a6 response_code = 204 uri = /vpc-routes
21422024-11-14T06:20:29.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60701
21432024-11-14T06:20:29.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60701 req_id = d5fad3a2-59e1-42e2-8823-3980e86ff923 response_code = 200 uri = /vpc-routes
21442024-11-14T06:20:29.789ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
21452024-11-14T06:20:29.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41657 req_id = 8d055863-b1e8-4141-9d35-33ba228636af response_code = 204 uri = /eip-gateways
21462024-11-14T06:20:29.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41657 req_id = d05c3afa-4355-4524-a44f-859fea40e7a7 response_code = 204 uri = /vpc-routes
21472024-11-14T06:20:29.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58556
21482024-11-14T06:20:29.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58556 req_id = 733d060f-35fe-45ea-ac4b-d50833346829 response_code = 200 uri = /v2p
21492024-11-14T06:20:29.910ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
21502024-11-14T06:20:29.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60701 req_id = ddc17802-9f5c-4553-aee8-67096751e0a9 response_code = 204 uri = /eip-gateways
21512024-11-14T06:20:29.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45160
21522024-11-14T06:20:29.930ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21532024-11-14T06:20:29.971ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21542024-11-14T06:20:30.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101042 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45160 req_id = d24b1af9-2181-42a3-8d9b-4ee2bcb992bf response_code = 204 uri = /switch-ports
21552024-11-14T06:20:30.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57909
21562024-11-14T06:20:30.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62252
21572024-11-14T06:20:30.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 400 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60701 req_id = ee39ec64-31f4-4fa9-a7fd-34e711b08d32 response_code = 204 uri = /vpc-routes
21582024-11-14T06:20:30.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45160 req_id = 10b17dc2-bebd-4e1d-a4a0-09dd398568d2 response_code = 200 uri = /network-bootstore-config
21592024-11-14T06:20:30.032ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21602024-11-14T06:20:30.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57909 req_id = 76d7e75f-9d4a-4173-8883-af9f4acbd11a response_code = 200 uri = /v2p
21612024-11-14T06:20:30.069ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21622024-11-14T06:20:30.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65049
21632024-11-14T06:20:30.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65049 req_id = 660affb9-4bd5-4039-80b7-ed139d0ca6f5 response_code = 200 uri = /v2p
21642024-11-14T06:20:30.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88841 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62252 req_id = ba64f9fb-d6a3-4c4c-967b-1c40604edd45 response_code = 204 uri = /switch-ports
21652024-11-14T06:20:30.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62252 req_id = 12c56efa-5895-4747-a9a7-48704efd2744 response_code = 200 uri = /network-bootstore-config
21662024-11-14T06:20:30.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33461
21672024-11-14T06:20:30.215ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21682024-11-14T06:20:30.250ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21692024-11-14T06:20:30.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90078 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33461 req_id = 1d8acd1b-4d8f-4866-ab7a-2c80ffc2c272 response_code = 204 uri = /switch-ports
21702024-11-14T06:20:30.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33461 req_id = b6578c5a-9df0-4eb0-be25-a7e597caab8e response_code = 200 uri = /network-bootstore-config
21712024-11-14T06:20:41.084ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48883
21722024-11-14T06:20:41.084ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48883 req_id = 109e6a56-20cd-4afc-b26d-e9485290c6f1 response_code = 200 uri = /baseboard
21732024-11-14T06:20:59.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50703
21742024-11-14T06:20:59.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50703 req_id = 9ef17ea6-f578-4538-b2c8-18b8d5a396d8 response_code = 200 uri = /vpc-routes
21752024-11-14T06:20:59.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58061
21762024-11-14T06:20:59.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58061 req_id = 0614d244-1660-45fb-98d0-183a9880add5 response_code = 200 uri = /vpc-routes
21772024-11-14T06:20:59.666ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
21782024-11-14T06:20:59.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50703 req_id = e996ccd3-d4bb-45d3-ab7e-76a7c4c46af6 response_code = 204 uri = /eip-gateways
21792024-11-14T06:20:59.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50703 req_id = 87282692-8d30-449e-9ce5-5d0476cca328 response_code = 204 uri = /vpc-routes
21802024-11-14T06:20:59.683ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
21812024-11-14T06:20:59.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58061 req_id = 1c8ade5c-b736-4a41-ba9c-2afddb30d7cb response_code = 204 uri = /eip-gateways
21822024-11-14T06:20:59.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64074
21832024-11-14T06:20:59.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58061 req_id = e2004d9a-d145-440c-a647-11925faa2dcb response_code = 204 uri = /vpc-routes
21842024-11-14T06:20:59.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39555
21852024-11-14T06:20:59.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39555 req_id = 7d4bd10b-5983-4750-9995-339a3b2d32e4 response_code = 200 uri = /vpc-routes
21862024-11-14T06:20:59.698ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21872024-11-14T06:20:59.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59459
21882024-11-14T06:20:59.744ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21892024-11-14T06:20:59.761ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
21902024-11-14T06:20:59.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 598 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39555 req_id = 3a8dcc10-72ad-41b7-b7e0-c21e2624dcdd response_code = 204 uri = /eip-gateways
21912024-11-14T06:20:59.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 757 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39555 req_id = 38a4cb5c-6527-4367-8c50-f8398e0c980b response_code = 204 uri = /vpc-routes
21922024-11-14T06:20:59.816ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21932024-11-14T06:20:59.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118293 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64074 req_id = b728e791-ad2f-445d-a20a-e8f35b180a4c response_code = 204 uri = /switch-ports
21942024-11-14T06:20:59.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 850 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64074 req_id = 6239c1f9-46e4-45bf-bf64-0adfc3a0da3e response_code = 200 uri = /network-bootstore-config
21952024-11-14T06:20:59.857ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21962024-11-14T06:20:59.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41173
21972024-11-14T06:20:59.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41173 req_id = 97384cd1-7415-4dd1-a30e-8109c764fda7 response_code = 200 uri = /v2p
21982024-11-14T06:20:59.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37134
21992024-11-14T06:20:59.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37134 req_id = e4aecc85-35df-4b22-adcc-9f7da4f27e50 response_code = 200 uri = /v2p
22002024-11-14T06:20:59.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36913
22012024-11-14T06:20:59.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36913 req_id = fa670d38-479f-4a63-adde-64540e795c1d response_code = 200 uri = /v2p
22022024-11-14T06:20:59.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57828
22032024-11-14T06:20:59.915ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22042024-11-14T06:20:59.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180885 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59459 req_id = 0ca8f310-1ee9-4c1f-bac7-e05faf0c6ecf response_code = 204 uri = /switch-ports
22052024-11-14T06:20:59.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 781 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59459 req_id = d6698af8-ec04-4b41-ac26-b2cc9e136a2d response_code = 200 uri = /network-bootstore-config
22062024-11-14T06:20:59.949ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22072024-11-14T06:21:00.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88319 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57828 req_id = 35ad2f4c-2b2b-4427-97ee-58de75a6e9ee response_code = 204 uri = /switch-ports
22082024-11-14T06:21:00.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57828 req_id = 65bcf6af-41ce-45bf-bc4d-8aa280e4486d response_code = 200 uri = /network-bootstore-config
22092024-11-14T06:21:11.116ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45624
22102024-11-14T06:21:11.116ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45624 req_id = e3159979-9e86-4bf9-b8bd-5cc99a59b2c8 response_code = 200 uri = /baseboard
22112024-11-14T06:21:29.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47095
22122024-11-14T06:21:29.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47095 req_id = 475d5b95-7561-4842-8a14-baf3e5fa0776 response_code = 200 uri = /vpc-routes
22132024-11-14T06:21:29.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44091
22142024-11-14T06:21:29.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44091 req_id = e94ff022-e1d5-4342-baf9-67e158b71cc5 response_code = 200 uri = /v2p
22152024-11-14T06:21:29.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33735
22162024-11-14T06:21:29.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33735 req_id = e02f8af2-3e0e-4778-bfac-1d5017231c12 response_code = 200 uri = /vpc-routes
22172024-11-14T06:21:29.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54862
22182024-11-14T06:21:29.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54862 req_id = 114ad6c0-9ec9-44da-92bd-75c0845254b3 response_code = 200 uri = /vpc-routes
22192024-11-14T06:21:29.905ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
22202024-11-14T06:21:29.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33735 req_id = cd3b98db-6c40-41b7-ac5b-bad8f581f455 response_code = 204 uri = /eip-gateways
22212024-11-14T06:21:29.908ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
22222024-11-14T06:21:29.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47095 req_id = cd9143f4-de9d-49dd-b7f5-fa296999fd18 response_code = 204 uri = /eip-gateways
22232024-11-14T06:21:29.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33735 req_id = 48554530-c0c1-446e-b4cc-24530a53ad61 response_code = 204 uri = /vpc-routes
22242024-11-14T06:21:29.929ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
22252024-11-14T06:21:29.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54862 req_id = c6f12e16-2e5c-4efc-bbea-cae4136f6408 response_code = 204 uri = /eip-gateways
22262024-11-14T06:21:29.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47095 req_id = a5601497-8286-4854-9b22-f604c8997a17 response_code = 204 uri = /vpc-routes
22272024-11-14T06:21:29.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54862 req_id = bf298862-c37b-4e2c-b184-bda54fa4afcc response_code = 204 uri = /vpc-routes
22282024-11-14T06:21:29.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63776
22292024-11-14T06:21:29.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63776 req_id = f12a4941-601a-4b94-b6d4-f8fbca59f3ff response_code = 200 uri = /v2p
22302024-11-14T06:21:29.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57146
22312024-11-14T06:21:29.983ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22322024-11-14T06:21:30.024ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22332024-11-14T06:21:30.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98987 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57146 req_id = 803a5c1c-c19a-4a80-868b-6858b9f8b22e response_code = 204 uri = /switch-ports
22342024-11-14T06:21:30.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55921
22352024-11-14T06:21:30.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61775
22362024-11-14T06:21:30.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57146 req_id = f403e29a-99e6-49c1-828a-67d5b309b807 response_code = 200 uri = /network-bootstore-config
22372024-11-14T06:21:30.083ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22382024-11-14T06:21:30.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61775 req_id = ed128ad9-4160-4a2c-b1a2-a46499dd2cc8 response_code = 200 uri = /v2p
22392024-11-14T06:21:30.117ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22402024-11-14T06:21:30.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47659
22412024-11-14T06:21:30.169ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22422024-11-14T06:21:30.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86244 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55921 req_id = 7e89f7f2-658e-4735-9fe1-86dc48a5c029 response_code = 204 uri = /switch-ports
22432024-11-14T06:21:30.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 723 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55921 req_id = cf539972-0ae8-4498-b10e-ec6b2bf47327 response_code = 200 uri = /network-bootstore-config
22442024-11-14T06:21:30.202ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22452024-11-14T06:21:30.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128728 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47659 req_id = d8abc850-f55c-4be6-9604-b08e860e10dd response_code = 204 uri = /switch-ports
22462024-11-14T06:21:30.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47659 req_id = 9729d9ef-1dbf-4d63-88a0-84bcda2b65e7 response_code = 200 uri = /network-bootstore-config
22472024-11-14T06:21:41.154ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46263
22482024-11-14T06:21:41.154ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46263 req_id = a413bdcc-b674-4e45-9124-b9cb5a816f3b response_code = 200 uri = /baseboard
22492024-11-14T06:21:59.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46568
22502024-11-14T06:21:59.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46568 req_id = 6aa16406-31cc-4ed6-935f-d88010f75a12 response_code = 200 uri = /vpc-routes
22512024-11-14T06:21:59.639ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
22522024-11-14T06:21:59.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46568 req_id = 7add3e36-2c3f-44b4-89ac-30450ab893c5 response_code = 204 uri = /eip-gateways
22532024-11-14T06:21:59.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46568 req_id = 3dd5b317-3a44-41f7-9ee3-3465efbcb285 response_code = 204 uri = /vpc-routes
22542024-11-14T06:21:59.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38086
22552024-11-14T06:21:59.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38086 req_id = 2f4deecb-2a3c-4ba8-b50c-58887083a643 response_code = 200 uri = /vpc-routes
22562024-11-14T06:21:59.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45370
22572024-11-14T06:21:59.720ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22582024-11-14T06:21:59.762ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22592024-11-14T06:21:59.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105798 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45370 req_id = 2caa739e-1995-4c4b-98ec-d9259f8a97d5 response_code = 204 uri = /switch-ports
22602024-11-14T06:21:59.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45735
22612024-11-14T06:21:59.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50939
22622024-11-14T06:21:59.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39538
22632024-11-14T06:21:59.826ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
22642024-11-14T06:21:59.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38086 req_id = 4e2f0221-a45b-4536-8774-46a54d7b212d response_code = 204 uri = /eip-gateways
22652024-11-14T06:21:59.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34953
22662024-11-14T06:21:59.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45370 req_id = 7a459cfc-40f5-42f6-b3be-2cd8fcfbf095 response_code = 200 uri = /network-bootstore-config
22672024-11-14T06:21:59.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34953 req_id = f2425f62-af63-4674-ac3d-7641deebae4d response_code = 200 uri = /vpc-routes
22682024-11-14T06:21:59.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39538 req_id = d3a51461-9f86-41b0-9947-b54a22793237 response_code = 200 uri = /v2p
22692024-11-14T06:21:59.827ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22702024-11-14T06:21:59.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5673 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45735 req_id = 326e6bf8-a8bd-4f1e-a5f2-782094f90f02 response_code = 200 uri = /v2p
22712024-11-14T06:21:59.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 586 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38086 req_id = 5404c227-0f89-469c-a675-b9f92889a1e4 response_code = 204 uri = /vpc-routes
22722024-11-14T06:21:59.848ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
22732024-11-14T06:21:59.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 687 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34953 req_id = 6a6b5e7b-591f-4c67-8d01-b3a8a1e1d79f response_code = 204 uri = /eip-gateways
22742024-11-14T06:21:59.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1684 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34953 req_id = 1a65878d-45ec-4ed2-b83a-862a89fbae67 response_code = 204 uri = /vpc-routes
22752024-11-14T06:21:59.869ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22762024-11-14T06:21:59.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51356
22772024-11-14T06:21:59.927ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22782024-11-14T06:21:59.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100112 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50939 req_id = 8f9626d4-0ba0-4f40-91a9-8f27d084e87e response_code = 204 uri = /switch-ports
22792024-11-14T06:21:59.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 724 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50939 req_id = f9fd95f3-aa4a-4eed-a6c6-9393647fcb06 response_code = 200 uri = /network-bootstore-config
22802024-11-14T06:21:59.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60942
22812024-11-14T06:21:59.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60942 req_id = 141cd884-15b5-4877-949b-849a46493e11 response_code = 200 uri = /v2p
22822024-11-14T06:21:59.962ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22832024-11-14T06:22:00.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98316 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51356 req_id = 66ffe629-f487-444e-a57a-d77ba0079ff6 response_code = 204 uri = /switch-ports
22842024-11-14T06:22:00.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51356 req_id = b423e3b0-d6bf-4553-ae91-c20bcfe7a232 response_code = 200 uri = /network-bootstore-config
22852024-11-14T06:22:11.186ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39763
22862024-11-14T06:22:11.186ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39763 req_id = 5cb24d36-67a8-40f5-9f9f-9d822b808848 response_code = 200 uri = /baseboard
22872024-11-14T06:22:27.665ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:64078 remote_addr = [fd00:1122:3344:101::d]:42661 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
22882024-11-14T06:22:27.717ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50642 local_addr = [fd00:1122:3344:101::1]:64078 method = GET remote_addr = [fd00:1122:3344:101::d]:42661 req_id = 087f44bf-b11f-4d26-9b3f-e1f9a6275465 response_code = 200 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d uri = /27a56cb4-44ff-4d5b-931e-1c2c0642844d
22892024-11-14T06:22:29.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58715
22902024-11-14T06:22:29.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58715 req_id = 81b1cd65-0188-48c9-82d8-41c82d82f42b response_code = 200 uri = /vpc-routes
22912024-11-14T06:22:29.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51305
22922024-11-14T06:22:29.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51305 req_id = df1cc382-db76-4ddf-b9d2-c4be930b59a0 response_code = 200 uri = /vpc-routes
22932024-11-14T06:22:29.807ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
22942024-11-14T06:22:29.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51305 req_id = b59e7737-ad87-4193-ac59-40ebfca1aa3a response_code = 204 uri = /eip-gateways
22952024-11-14T06:22:29.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51305 req_id = 596bf357-7ca1-40af-92da-8f14bbeb9385 response_code = 204 uri = /vpc-routes
22962024-11-14T06:22:29.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60279
22972024-11-14T06:22:29.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60279 req_id = 477e3815-9136-4fee-98e2-88323aba49ee response_code = 200 uri = /v2p
22982024-11-14T06:22:29.998ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
22992024-11-14T06:22:29.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58715 req_id = 63210cee-846f-44c0-819d-91e7586faaf7 response_code = 204 uri = /eip-gateways
23002024-11-14T06:22:30.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58715 req_id = f0b577a9-5834-42d3-b56d-089168c8a68a response_code = 204 uri = /vpc-routes
23012024-11-14T06:22:30.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65230
23022024-11-14T06:22:30.012ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23032024-11-14T06:22:30.063ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23042024-11-14T06:22:30.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111783 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65230 req_id = c8c013a9-53a9-48dd-8f32-90fcca45060a response_code = 204 uri = /switch-ports
23052024-11-14T06:22:30.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33367
23062024-11-14T06:22:30.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42655
23072024-11-14T06:22:30.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65230 req_id = 3b8da359-f531-4e24-ba07-7e8a52173ac8 response_code = 200 uri = /network-bootstore-config
23082024-11-14T06:22:30.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33367 req_id = d0f280f8-74b6-4d43-8265-9502c3f2fe63 response_code = 200 uri = /v2p
23092024-11-14T06:22:30.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42655 req_id = 58d436ef-1176-4cb3-a2c6-fa455ffb6177 response_code = 200 uri = /vpc-routes
23102024-11-14T06:22:30.141ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
23112024-11-14T06:22:30.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42655 req_id = 662f7ada-0bde-4bd5-b2e7-0dbe7e00a672 response_code = 204 uri = /eip-gateways
23122024-11-14T06:22:30.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53995
23132024-11-14T06:22:30.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53995 req_id = a2eaffea-c697-472b-a90c-e1e4e77c90b0 response_code = 200 uri = /v2p
23142024-11-14T06:22:30.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52294
23152024-11-14T06:22:30.154ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23162024-11-14T06:22:30.193ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23172024-11-14T06:22:30.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96205 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52294 req_id = cdb422c7-1a77-431d-859b-6bb6ac8ae099 response_code = 204 uri = /switch-ports
23182024-11-14T06:22:30.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50093
23192024-11-14T06:22:30.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52294 req_id = 82a55ee2-15d3-4467-81e3-82544adf5a7d response_code = 200 uri = /network-bootstore-config
23202024-11-14T06:22:30.251ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23212024-11-14T06:22:30.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5928 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42655 req_id = 3f36a67f-b89c-4f28-90ab-9ef23b839fab response_code = 204 uri = /vpc-routes
23222024-11-14T06:22:30.291ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23232024-11-14T06:22:30.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94881 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50093 req_id = bd1b9eab-db70-4e7f-b380-b7fa311cb556 response_code = 204 uri = /switch-ports
23242024-11-14T06:22:30.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50093 req_id = c58c7285-d230-49e0-b5dc-4aaa7c0acc85 response_code = 200 uri = /network-bootstore-config
23252024-11-14T06:22:41.224ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53142
23262024-11-14T06:22:41.224ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53142 req_id = e31ec929-abda-42e4-9818-5bc91a0b7feb response_code = 200 uri = /baseboard
23272024-11-14T06:22:59.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51830
23282024-11-14T06:22:59.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51830 req_id = e508c734-eeaa-4910-a491-ff7743ce8aa5 response_code = 200 uri = /vpc-routes
23292024-11-14T06:22:59.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38338
23302024-11-14T06:22:59.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38338 req_id = 0fc160d3-3f81-45b0-b1ea-33497b88f9f4 response_code = 200 uri = /vpc-routes
23312024-11-14T06:22:59.654ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
23322024-11-14T06:22:59.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38338 req_id = 8494feea-29c4-4812-8914-317e5b51b57c response_code = 204 uri = /eip-gateways
23332024-11-14T06:22:59.663ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
23342024-11-14T06:22:59.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51830 req_id = ffc3d1d9-f05c-45ac-a619-2904c00ab29c response_code = 204 uri = /eip-gateways
23352024-11-14T06:22:59.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38338 req_id = c002d29a-059e-43f4-8ea8-6bbf65a44d93 response_code = 204 uri = /vpc-routes
23362024-11-14T06:22:59.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51830 req_id = a31077be-7161-4d55-aa39-8d92a065ab6b response_code = 204 uri = /vpc-routes
23372024-11-14T06:22:59.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49459
23382024-11-14T06:22:59.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49459 req_id = 139b97a8-1455-440a-ac48-3c73c3d14587 response_code = 200 uri = /v2p
23392024-11-14T06:22:59.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57413
23402024-11-14T06:22:59.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57413 req_id = e2784310-b520-4f75-952e-c2eb637e9dfd response_code = 200 uri = /v2p
23412024-11-14T06:22:59.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54531
23422024-11-14T06:22:59.754ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23432024-11-14T06:22:59.802ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23442024-11-14T06:22:59.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110142 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54531 req_id = 81319bfd-8075-4640-b5c3-b48714d3425c response_code = 204 uri = /switch-ports
23452024-11-14T06:22:59.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43118
23462024-11-14T06:22:59.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62369
23472024-11-14T06:22:59.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43327
23482024-11-14T06:22:59.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43118 req_id = 01e0d32e-82f7-4ad9-ab77-96112c78852e response_code = 200 uri = /vpc-routes
23492024-11-14T06:22:59.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54531 req_id = e6a7da90-1034-41b5-9c0f-831ac18a412c response_code = 200 uri = /network-bootstore-config
23502024-11-14T06:22:59.865ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23512024-11-14T06:22:59.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5479 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62369 req_id = f4604348-3ca9-4fb0-9c30-257b582e0c16 response_code = 200 uri = /v2p
23522024-11-14T06:22:59.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52120
23532024-11-14T06:22:59.913ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23542024-11-14T06:22:59.919ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
23552024-11-14T06:22:59.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 652 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43118 req_id = bf22f419-47be-4bba-a958-96ce03d90d6a response_code = 204 uri = /eip-gateways
23562024-11-14T06:22:59.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 726 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43118 req_id = 9af82f76-cbda-41c3-ac02-94c13f7e9354 response_code = 204 uri = /vpc-routes
23572024-11-14T06:22:59.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109227 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43327 req_id = c025074b-d328-43a7-9b29-736a3aa9dd27 response_code = 204 uri = /switch-ports
23582024-11-14T06:22:59.974ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23592024-11-14T06:22:59.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 760 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43327 req_id = b851cbd5-54b6-4eaa-b773-83f35b6b35ef response_code = 200 uri = /network-bootstore-config
23602024-11-14T06:23:00.011ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23612024-11-14T06:23:00.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183958 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52120 req_id = 39245e86-8b7e-4953-8e06-198fd129b133 response_code = 204 uri = /switch-ports
23622024-11-14T06:23:00.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52120 req_id = 136b2b4b-6815-40ce-8b50-5f7fa43167be response_code = 200 uri = /network-bootstore-config
23632024-11-14T06:23:11.258ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59254
23642024-11-14T06:23:11.258ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59254 req_id = 6705a9fa-0444-4090-8975-c56e3ffbaddb response_code = 200 uri = /baseboard
23652024-11-14T06:23:29.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43778
23662024-11-14T06:23:29.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43778 req_id = b198bfe4-5cc3-47af-b93b-75002cc0a25c response_code = 200 uri = /vpc-routes
23672024-11-14T06:23:29.796ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
23682024-11-14T06:23:29.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43778 req_id = 19d4798d-ae8c-4f0f-a9b8-5351c5f8b52d response_code = 204 uri = /eip-gateways
23692024-11-14T06:23:29.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61765
23702024-11-14T06:23:29.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61765 req_id = dcbbb6d4-ce02-4cf7-953a-cb2b5016ea61 response_code = 200 uri = /vpc-routes
23712024-11-14T06:23:29.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43778 req_id = bfd331f1-2d06-4855-a5b0-2e5f1073e309 response_code = 204 uri = /vpc-routes
23722024-11-14T06:23:29.854ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
23732024-11-14T06:23:29.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61765 req_id = aaf4f915-9981-4604-8081-9bc27f669458 response_code = 204 uri = /eip-gateways
23742024-11-14T06:23:29.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61765 req_id = abf9f8f6-ef62-4988-8498-a53f7a96eb29 response_code = 204 uri = /vpc-routes
23752024-11-14T06:23:29.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43812
23762024-11-14T06:23:29.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43812 req_id = 60fe635a-097d-4758-ad29-53eb5c380386 response_code = 200 uri = /v2p
23772024-11-14T06:23:29.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34020
23782024-11-14T06:23:29.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34020 req_id = 188582a4-e2cb-4e4a-bafd-0cc94b61f9ee response_code = 200 uri = /vpc-routes
23792024-11-14T06:23:29.928ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
23802024-11-14T06:23:29.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34020 req_id = d2016867-8bea-4267-b645-f555445ebf34 response_code = 204 uri = /eip-gateways
23812024-11-14T06:23:29.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34020 req_id = 0b0c9ba2-a284-418d-87d5-420fff64da62 response_code = 204 uri = /vpc-routes
23822024-11-14T06:23:29.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48791
23832024-11-14T06:23:29.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48791 req_id = 03499241-a01b-4a38-8073-0b549f88bf14 response_code = 200 uri = /v2p
23842024-11-14T06:23:30.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57301
23852024-11-14T06:23:30.011ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23862024-11-14T06:23:30.053ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23872024-11-14T06:23:30.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98614 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57301 req_id = ac54539d-2e5a-4637-b5d2-af6e0deaf11e response_code = 204 uri = /switch-ports
23882024-11-14T06:23:30.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40499
23892024-11-14T06:23:30.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49139
23902024-11-14T06:23:30.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58433
23912024-11-14T06:23:30.110ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23922024-11-14T06:23:30.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3457 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57301 req_id = 35960ff9-207b-4354-85e0-b54f40984c46 response_code = 200 uri = /network-bootstore-config
23932024-11-14T06:23:30.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3763 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49139 req_id = a2f92c3f-f93e-4559-b7ac-057da4fef975 response_code = 200 uri = /v2p
23942024-11-14T06:23:30.144ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23952024-11-14T06:23:30.201ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23962024-11-14T06:23:30.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90942 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58433 req_id = d7ef7da1-22d5-4129-bb12-fc07c6082542 response_code = 204 uri = /switch-ports
23972024-11-14T06:23:30.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 371 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58433 req_id = b20d8d24-16ea-484a-9e33-89a1df2c1f8b response_code = 200 uri = /network-bootstore-config
23982024-11-14T06:23:30.237ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23992024-11-14T06:23:30.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182373 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40499 req_id = bd059810-df5c-4cdc-902a-c3e662538393 response_code = 204 uri = /switch-ports
24002024-11-14T06:23:30.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40499 req_id = ae75387d-3f08-4182-94e5-6659839dc841 response_code = 200 uri = /network-bootstore-config
24012024-11-14T06:23:41.292ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37912
24022024-11-14T06:23:41.292ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37912 req_id = 59a4d894-5a77-42a9-ad49-9f63ba0a76a1 response_code = 200 uri = /baseboard
24032024-11-14T06:23:59.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54890
24042024-11-14T06:23:59.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54890 req_id = 186796ca-db7c-4962-8f17-c86c7cd69275 response_code = 200 uri = /vpc-routes
24052024-11-14T06:23:59.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64364
24062024-11-14T06:23:59.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64364 req_id = 4a2fa409-44e1-4c1e-bef0-ed59649c1a68 response_code = 200 uri = /vpc-routes
24072024-11-14T06:23:59.672ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
24082024-11-14T06:23:59.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54890 req_id = 529e146e-d475-4124-afa6-3921c4621864 response_code = 204 uri = /eip-gateways
24092024-11-14T06:23:59.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54890 req_id = c2a5de93-89ed-46c5-9732-bfeb689c738b response_code = 204 uri = /vpc-routes
24102024-11-14T06:23:59.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53960
24112024-11-14T06:23:59.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53960 req_id = b4a88c99-ee12-4675-a17f-d62bea68a6ed response_code = 200 uri = /v2p
24122024-11-14T06:23:59.721ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
24132024-11-14T06:23:59.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64364 req_id = 8ca79e5d-5308-40fa-a1e2-894853553075 response_code = 204 uri = /eip-gateways
24142024-11-14T06:23:59.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64364 req_id = 1c145382-e637-4d2c-a537-ac7ec70b7cf5 response_code = 204 uri = /vpc-routes
24152024-11-14T06:23:59.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65488
24162024-11-14T06:23:59.761ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24172024-11-14T06:23:59.813ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24182024-11-14T06:23:59.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126426 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65488 req_id = 4a4e8f9b-841c-481f-aefb-aff5d652df6b response_code = 204 uri = /switch-ports
24192024-11-14T06:23:59.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58450
24202024-11-14T06:23:59.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43864
24212024-11-14T06:23:59.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48527
24222024-11-14T06:23:59.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65488 req_id = b60206ef-0f57-4ba2-913a-ada429682294 response_code = 200 uri = /network-bootstore-config
24232024-11-14T06:23:59.888ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24242024-11-14T06:23:59.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43864 req_id = b6d871c4-c13f-4ca0-830b-814b966f8c3a response_code = 200 uri = /vpc-routes
24252024-11-14T06:23:59.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48527 req_id = df0292dc-ae72-4611-a436-c45fdf7c9b66 response_code = 200 uri = /v2p
24262024-11-14T06:23:59.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58049
24272024-11-14T06:23:59.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58049 req_id = ae109dfa-c0b0-4346-9080-94da4fff2b8f response_code = 200 uri = /v2p
24282024-11-14T06:23:59.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43234
24292024-11-14T06:23:59.929ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24302024-11-14T06:23:59.934ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
24312024-11-14T06:23:59.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43864 req_id = b2dc3d05-5ade-4c3c-b0b8-dec400f2e2d2 response_code = 204 uri = /eip-gateways
24322024-11-14T06:23:59.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 748 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43864 req_id = 85221bfb-c050-4405-8df2-7a2ded638cb5 response_code = 204 uri = /vpc-routes
24332024-11-14T06:23:59.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106280 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58450 req_id = fe768652-fc30-4da7-8b4f-99b18ceba589 response_code = 204 uri = /switch-ports
24342024-11-14T06:23:59.994ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24352024-11-14T06:23:59.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 762 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58450 req_id = d14253c0-469a-445d-9c54-42616c6dd7f7 response_code = 200 uri = /network-bootstore-config
24362024-11-14T06:24:00.035ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24372024-11-14T06:24:00.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164783 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43234 req_id = bc39f1aa-27cd-4b12-ae4b-7648a18a5798 response_code = 204 uri = /switch-ports
24382024-11-14T06:24:00.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43234 req_id = aadab568-95ec-4fcd-8b50-b77a2b10ae15 response_code = 200 uri = /network-bootstore-config
24392024-11-14T06:24:11.326ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55703
24402024-11-14T06:24:11.326ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55703 req_id = 36ed339e-726d-411c-8474-1c7dc33ff90a response_code = 200 uri = /baseboard
24412024-11-14T06:24:20.510ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24422024-11-14T06:24:20.510ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24432024-11-14T06:24:20.537ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1917, tv_nsec: 95541983 } time_to_next_cleanup = 599.99999631s
24442024-11-14T06:24:29.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60442
24452024-11-14T06:24:29.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60442 req_id = 3bad0290-9b7b-4574-bb7e-3e24c772e11e response_code = 200 uri = /vpc-routes
24462024-11-14T06:24:29.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40611
24472024-11-14T06:24:29.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40611 req_id = 8b855e38-6676-4b8c-a508-36106157d996 response_code = 200 uri = /vpc-routes
24482024-11-14T06:24:29.895ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
24492024-11-14T06:24:29.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60442 req_id = 64704e06-ab5d-4252-b5f1-eb0e449fb570 response_code = 204 uri = /eip-gateways
24502024-11-14T06:24:29.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60442 req_id = 6b31c9d9-4c23-4a44-a660-4e68dbdcb162 response_code = 204 uri = /vpc-routes
24512024-11-14T06:24:29.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33207
24522024-11-14T06:24:29.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33207 req_id = 966a511c-49c4-45ea-8052-6806207e90c0 response_code = 200 uri = /vpc-routes
24532024-11-14T06:24:29.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38739
24542024-11-14T06:24:29.952ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24552024-11-14T06:24:30.002ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24562024-11-14T06:24:30.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119957 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38739 req_id = 12cbd4d0-771e-4a16-85f5-cb4a228fb1d6 response_code = 204 uri = /switch-ports
24572024-11-14T06:24:30.072ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
24582024-11-14T06:24:30.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40611 req_id = 752a2b71-f3dc-40e6-94ca-f2e2adeff688 response_code = 204 uri = /eip-gateways
24592024-11-14T06:24:30.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38503
24602024-11-14T06:24:30.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56029
24612024-11-14T06:24:30.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45858
24622024-11-14T06:24:30.073ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
24632024-11-14T06:24:30.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33207 req_id = 417a3d69-6ae3-4db4-bad7-7ca72720e596 response_code = 204 uri = /eip-gateways
24642024-11-14T06:24:30.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48690
24652024-11-14T06:24:30.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38739 req_id = a69145d4-7979-4295-bff3-1e414a47dd44 response_code = 200 uri = /network-bootstore-config
24662024-11-14T06:24:30.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38503 req_id = 04a6bca3-392d-4199-b041-e2a6858dd7c1 response_code = 200 uri = /v2p
24672024-11-14T06:24:30.073ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24682024-11-14T06:24:30.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56029 req_id = dbe424b2-c188-4825-a1e6-828fac29db5a response_code = 200 uri = /v2p
24692024-11-14T06:24:30.073ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24702024-11-14T06:24:30.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24712024-11-14T06:24:30.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24722024-11-14T06:24:30.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24732024-11-14T06:24:30.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24742024-11-14T06:24:30.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24752024-11-14T06:24:30.073ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
24762024-11-14T06:24:30.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48690 req_id = c5bbfeec-4cdf-4c7c-84b6-9113f3d14788 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24772024-11-14T06:24:30.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40611 req_id = 6ad822dc-1b93-4ce1-9a66-5758a64113e6 response_code = 204 uri = /vpc-routes
24782024-11-14T06:24:30.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34838
24792024-11-14T06:24:30.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34838 req_id = 18656c12-c786-4348-a69b-00e09d3d240a response_code = 200 uri = /v2p
24802024-11-14T06:24:30.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 473 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33207 req_id = b35d4196-9f35-4056-8a8c-64bc33568b3e response_code = 204 uri = /vpc-routes
24812024-11-14T06:24:30.119ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24822024-11-14T06:24:30.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58084
24832024-11-14T06:24:30.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36736
24842024-11-14T06:24:30.184ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24852024-11-14T06:24:30.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24862024-11-14T06:24:30.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24872024-11-14T06:24:30.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24882024-11-14T06:24:30.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24892024-11-14T06:24:30.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24902024-11-14T06:24:30.184ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
24912024-11-14T06:24:30.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36736 req_id = c526bd1b-f661-40f4-b1be-d386c73cb4e5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24922024-11-14T06:24:30.185ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24932024-11-14T06:24:30.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111999 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45858 req_id = 801016d0-916a-42d7-9b5e-4650bb51117e response_code = 204 uri = /switch-ports
24942024-11-14T06:24:30.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45858 req_id = 528964e4-2373-472a-84b9-8d6fd465e579 response_code = 200 uri = /network-bootstore-config
24952024-11-14T06:24:30.226ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24962024-11-14T06:24:30.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141475 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58084 req_id = 95b73faf-1843-49ed-960b-f990d7ec5878 response_code = 204 uri = /switch-ports
24972024-11-14T06:24:30.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58084 req_id = 2e1c9f7b-0925-446d-bdd9-5f6522a3216f response_code = 200 uri = /network-bootstore-config
24982024-11-14T06:24:30.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33208
24992024-11-14T06:24:30.318ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25002024-11-14T06:24:30.318ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25012024-11-14T06:24:30.318ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25022024-11-14T06:24:30.318ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25032024-11-14T06:24:30.318ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25042024-11-14T06:24:30.318ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25052024-11-14T06:24:30.318ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
25062024-11-14T06:24:30.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33208 req_id = cdc4eaab-c767-48d6-a546-5644cd07b677 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25072024-11-14T06:24:34.885ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
25082024-11-14T06:24:41.360ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56198
25092024-11-14T06:24:41.360ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56198 req_id = 6a55f296-ecf4-49d0-8b14-d3f2be0f9171 response_code = 200 uri = /baseboard
25102024-11-14T06:24:59.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47412
25112024-11-14T06:24:59.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47412 req_id = 363cd220-8a2b-4bb1-83e9-7420d71e4fcb response_code = 200 uri = /vpc-routes
25122024-11-14T06:24:59.631ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
25132024-11-14T06:24:59.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47412 req_id = f49cfe2e-2840-41fd-98d6-0230e03f21f1 response_code = 204 uri = /eip-gateways
25142024-11-14T06:24:59.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47412 req_id = b90d7953-6c7f-4089-b952-77683093264d response_code = 204 uri = /vpc-routes
25152024-11-14T06:24:59.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42552
25162024-11-14T06:24:59.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42552 req_id = 71d8eef5-8b44-4b2d-a923-acf781146e79 response_code = 200 uri = /vpc-routes
25172024-11-14T06:24:59.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40711
25182024-11-14T06:24:59.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40711 req_id = 91ca2b19-9902-4ca6-9e01-3ae090804851 response_code = 200 uri = /v2p
25192024-11-14T06:24:59.710ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
25202024-11-14T06:24:59.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42552 req_id = 6a91cef6-a888-480d-91aa-540f2237d2ed response_code = 204 uri = /eip-gateways
25212024-11-14T06:24:59.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42552 req_id = 442d9a4e-bb99-4c1d-9c57-26dd49e7b449 response_code = 204 uri = /vpc-routes
25222024-11-14T06:24:59.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52204
25232024-11-14T06:24:59.757ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25242024-11-14T06:24:59.798ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25252024-11-14T06:24:59.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99151 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52204 req_id = d8cfea28-ce5d-4aaf-b0ee-d5dd2be6ea16 response_code = 204 uri = /switch-ports
25262024-11-14T06:24:59.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50565
25272024-11-14T06:24:59.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34481
25282024-11-14T06:24:59.857ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25292024-11-14T06:24:59.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3581 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52204 req_id = 3e22989a-729b-4b65-a885-2ee1bd7b8fad response_code = 200 uri = /network-bootstore-config
25302024-11-14T06:24:59.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3533 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50565 req_id = fb5b69cb-e616-4f16-97d3-9a923ef2333d response_code = 200 uri = /v2p
25312024-11-14T06:24:59.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52427
25322024-11-14T06:24:59.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52427 req_id = 2bd9f896-4798-4726-af02-2261028a2dff response_code = 200 uri = /vpc-routes
25332024-11-14T06:24:59.893ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25342024-11-14T06:24:59.908ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
25352024-11-14T06:24:59.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 608 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52427 req_id = 6bdf7577-907a-47ee-97e7-24fd2a151ec9 response_code = 204 uri = /eip-gateways
25362024-11-14T06:24:59.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95443 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34481 req_id = 2f5b807c-ed8c-42b2-b806-8e5553a9e941 response_code = 204 uri = /switch-ports
25372024-11-14T06:24:59.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34481 req_id = 431022b2-f228-4592-951f-cf8552d4a5a6 response_code = 200 uri = /network-bootstore-config
25382024-11-14T06:24:59.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35741
25392024-11-14T06:24:59.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35741 req_id = 4b186aaa-96a8-42f1-b1b5-782e7c658288 response_code = 200 uri = /v2p
25402024-11-14T06:24:59.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52427 req_id = d0d772e8-de85-4c89-a88b-f05ffb9d9314 response_code = 204 uri = /vpc-routes
25412024-11-14T06:24:59.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41740
25422024-11-14T06:24:59.989ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25432024-11-14T06:25:00.029ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25442024-11-14T06:25:00.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96122 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41740 req_id = 7f59cde1-0374-4ad6-84b7-7b7c372cc541 response_code = 204 uri = /switch-ports
25452024-11-14T06:25:00.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41740 req_id = de058ce5-7921-40c3-9de7-9944d337d54b response_code = 200 uri = /network-bootstore-config
25462024-11-14T06:25:11.397ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51765
25472024-11-14T06:25:11.397ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51765 req_id = e86b0511-20f5-47cb-8e67-8106a737f1c0 response_code = 200 uri = /baseboard
25482024-11-14T06:25:29.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50887
25492024-11-14T06:25:29.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50887 req_id = 0341dae2-e554-404b-8896-209b7c6636e2 response_code = 200 uri = /vpc-routes
25502024-11-14T06:25:29.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47082
25512024-11-14T06:25:29.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47082 req_id = 657b6b8c-b6b1-4f2b-b885-29301e7c0bab response_code = 200 uri = /vpc-routes
25522024-11-14T06:25:29.859ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
25532024-11-14T06:25:29.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47082 req_id = 2c3ffa55-5b41-48ee-a9a4-f6bb5c05b139 response_code = 204 uri = /eip-gateways
25542024-11-14T06:25:29.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47082 req_id = 50b97dd8-7a23-42df-8ab2-c8e7835175e0 response_code = 204 uri = /vpc-routes
25552024-11-14T06:25:29.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53596
25562024-11-14T06:25:29.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53596 req_id = 3f1c996c-8e9c-4f22-bdad-1c86259661d3 response_code = 200 uri = /v2p
25572024-11-14T06:25:29.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47660
25582024-11-14T06:25:29.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47660 req_id = cc85d7f1-4462-44a2-845e-51dd76472bb7 response_code = 200 uri = /v2p
25592024-11-14T06:25:29.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55515
25602024-11-14T06:25:29.946ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25612024-11-14T06:25:29.992ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25622024-11-14T06:25:30.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109281 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55515 req_id = ea4b1b20-3204-4a1c-b218-2d4e4c6bc97c response_code = 204 uri = /switch-ports
25632024-11-14T06:25:30.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54019
25642024-11-14T06:25:30.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39911
25652024-11-14T06:25:30.056ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
25662024-11-14T06:25:30.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50887 req_id = 47941dcc-47f4-4dde-9d65-29e61ea29e21 response_code = 204 uri = /eip-gateways
25672024-11-14T06:25:30.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51769
25682024-11-14T06:25:30.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54019 req_id = f3de8228-ce7f-49a5-8e09-643d8375e1d6 response_code = 200 uri = /vpc-routes
25692024-11-14T06:25:30.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55515 req_id = ad2b7548-8eaa-4212-aa91-99a37216f41a response_code = 200 uri = /network-bootstore-config
25702024-11-14T06:25:30.056ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25712024-11-14T06:25:30.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51769 req_id = 3e91ef20-b71d-401a-b83e-fb7de42b5bd2 response_code = 200 uri = /v2p
25722024-11-14T06:25:30.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 649 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50887 req_id = f0d5dea5-d752-4f9c-86f0-479e49d13718 response_code = 204 uri = /vpc-routes
25732024-11-14T06:25:30.096ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25742024-11-14T06:25:30.101ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
25752024-11-14T06:25:30.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54019 req_id = a8a70508-5bb1-4837-bf95-b640d5fa5bcc response_code = 204 uri = /eip-gateways
25762024-11-14T06:25:30.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1078 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54019 req_id = 1f7455bc-f710-412f-a727-e515a2d81b66 response_code = 204 uri = /vpc-routes
25772024-11-14T06:25:30.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99408 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39911 req_id = 71ff0912-ea88-430b-ac6e-65ee319a8b89 response_code = 204 uri = /switch-ports
25782024-11-14T06:25:30.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39911 req_id = 5d7d62f1-5291-4cd5-8833-f5f29bee576d response_code = 200 uri = /network-bootstore-config
25792024-11-14T06:25:30.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34597
25802024-11-14T06:25:30.158ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25812024-11-14T06:25:30.194ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25822024-11-14T06:25:30.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88420 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34597 req_id = 32417414-52f7-45e1-8a0b-1650b8c09880 response_code = 204 uri = /switch-ports
25832024-11-14T06:25:30.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34597 req_id = 60ba588b-2974-4b4a-84d6-523190386dd0 response_code = 200 uri = /network-bootstore-config
25842024-11-14T06:25:41.431ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62386
25852024-11-14T06:25:41.432ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62386 req_id = 618eb8eb-2e16-4b33-8d10-7faed8aac8f8 response_code = 200 uri = /baseboard
25862024-11-14T06:25:59.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51969
25872024-11-14T06:25:59.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51969 req_id = 9095a571-af73-425f-ad16-8ba1d542a9e9 response_code = 200 uri = /vpc-routes
25882024-11-14T06:25:59.658ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
25892024-11-14T06:25:59.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51969 req_id = 5771bd0f-4988-4c3c-bdb0-54c48c5b8941 response_code = 204 uri = /eip-gateways
25902024-11-14T06:25:59.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51969 req_id = 9c1ffdd6-c62f-4cb9-9a97-e44512a3bb2e response_code = 204 uri = /vpc-routes
25912024-11-14T06:25:59.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60641
25922024-11-14T06:25:59.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60641 req_id = a2cd08cf-717f-4033-a864-a2e345ed1a24 response_code = 200 uri = /vpc-routes
25932024-11-14T06:25:59.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42579
25942024-11-14T06:25:59.714ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
25952024-11-14T06:25:59.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42579 req_id = 1383b6e8-f15a-4e1e-9e0e-ea2b574fcb65 response_code = 200 uri = /v2p
25962024-11-14T06:25:59.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60641 req_id = 7b4e663e-85c8-4a63-a76e-8e0bbfa6aee1 response_code = 204 uri = /eip-gateways
25972024-11-14T06:25:59.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60641 req_id = c61c5e29-fc5e-4bbf-b312-6d476de5ad49 response_code = 204 uri = /vpc-routes
25982024-11-14T06:25:59.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52295
25992024-11-14T06:25:59.767ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26002024-11-14T06:25:59.807ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26012024-11-14T06:25:59.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98006 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52295 req_id = 7993c316-c8d4-466c-bf5e-1d0cdadfc9ce response_code = 204 uri = /switch-ports
26022024-11-14T06:25:59.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50168
26032024-11-14T06:25:59.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47701
26042024-11-14T06:25:59.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54110
26052024-11-14T06:25:59.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44636
26062024-11-14T06:25:59.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63700
26072024-11-14T06:25:59.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47701 req_id = e8d46c24-265a-4d7d-b88c-030def89c237 response_code = 200 uri = /vpc-routes
26082024-11-14T06:25:59.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44636 req_id = 53506a26-2e68-42c2-b0e5-214aa7727180 response_code = 200 uri = /v2p
26092024-11-14T06:25:59.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 387 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54110 req_id = ef9efb7f-b6ab-49ff-a340-0d7eeac57d73 response_code = 200 uri = /v2p
26102024-11-14T06:25:59.866ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26112024-11-14T06:25:59.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52295 req_id = f93e051a-29f3-49aa-9dd2-c3c60f3d21c7 response_code = 200 uri = /network-bootstore-config
26122024-11-14T06:25:59.907ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
26132024-11-14T06:25:59.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47701 req_id = de183f2e-538c-4b0d-ad08-ab19b6278135 response_code = 204 uri = /eip-gateways
26142024-11-14T06:25:59.908ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26152024-11-14T06:25:59.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47701 req_id = 1ccd4692-332d-4d2f-970c-dcf99cd39c33 response_code = 204 uri = /vpc-routes
26162024-11-14T06:25:59.970ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26172024-11-14T06:25:59.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104492 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50168 req_id = a46b5b0f-3c94-4cee-ba21-0de3316ab523 response_code = 204 uri = /switch-ports
26182024-11-14T06:25:59.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 841 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50168 req_id = 5b91ad5e-394d-4c68-893f-d941c841e169 response_code = 200 uri = /network-bootstore-config
26192024-11-14T06:26:00.010ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26202024-11-14T06:26:00.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201157 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63700 req_id = 5737b28f-6069-4c0c-8587-3d2ae6469081 response_code = 204 uri = /switch-ports
26212024-11-14T06:26:00.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63700 req_id = 88d9bec6-15d0-48cf-a8a3-732bd82229b3 response_code = 200 uri = /network-bootstore-config
26222024-11-14T06:26:11.469ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59716
26232024-11-14T06:26:11.469ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59716 req_id = 6b8f9efc-fc20-4fd8-adfb-979c879d51da response_code = 200 uri = /baseboard
26242024-11-14T06:26:29.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44323
26252024-11-14T06:26:29.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44323 req_id = af4bda45-7ab5-4f7e-9c29-3201a382ad08 response_code = 200 uri = /vpc-routes
26262024-11-14T06:26:29.771ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
26272024-11-14T06:26:29.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44323 req_id = 01664559-ae15-4400-a344-c14c4b69e439 response_code = 204 uri = /eip-gateways
26282024-11-14T06:26:29.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44323 req_id = 775ab34c-9548-4543-a5a9-7cd36568edce response_code = 204 uri = /vpc-routes
26292024-11-14T06:26:29.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50434
26302024-11-14T06:26:29.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50434 req_id = e547e3d2-614c-4c63-b373-f4b016e945b5 response_code = 200 uri = /vpc-routes
26312024-11-14T06:26:29.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33899
26322024-11-14T06:26:29.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33899 req_id = c7ec985f-a8e7-4da9-a396-0d880d315f03 response_code = 200 uri = /v2p
26332024-11-14T06:26:29.826ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
26342024-11-14T06:26:29.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50434 req_id = 29dc68ec-cb8b-4e73-9beb-75ab4e3efdb4 response_code = 204 uri = /eip-gateways
26352024-11-14T06:26:29.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50434 req_id = 4b234ab8-0776-4254-8425-6f3b26bb4d84 response_code = 204 uri = /vpc-routes
26362024-11-14T06:26:29.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34153
26372024-11-14T06:26:29.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34153 req_id = 75a1dd20-f67f-48c4-8c62-3baf921528a1 response_code = 200 uri = /vpc-routes
26382024-11-14T06:26:29.895ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
26392024-11-14T06:26:29.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34153 req_id = 5b1012c8-953e-4bfa-b5c6-6c7ebfd9f4c2 response_code = 204 uri = /eip-gateways
26402024-11-14T06:26:29.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34153 req_id = 97d340a9-2e91-46ae-854b-5428113c0717 response_code = 204 uri = /vpc-routes
26412024-11-14T06:26:29.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56801
26422024-11-14T06:26:29.932ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26432024-11-14T06:26:29.973ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26442024-11-14T06:26:30.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56801 req_id = e15acf4d-af73-4a27-8df5-d94af07186b3 response_code = 204 uri = /switch-ports
26452024-11-14T06:26:30.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57575
26462024-11-14T06:26:30.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56801 req_id = daef1d02-864e-4bd0-a275-bc65bae1e7f7 response_code = 200 uri = /network-bootstore-config
26472024-11-14T06:26:30.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57575 req_id = 41eb2d6a-6a27-46c2-bc39-14b1269e0198 response_code = 200 uri = /v2p
26482024-11-14T06:26:30.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53525
26492024-11-14T06:26:30.087ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26502024-11-14T06:26:30.126ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26512024-11-14T06:26:30.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94960 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53525 req_id = 7f3ba7ef-77e2-4f6f-9835-83832e44eeed response_code = 204 uri = /switch-ports
26522024-11-14T06:26:30.182ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39092
26532024-11-14T06:26:30.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39092 req_id = de2b577a-3bc0-4532-8fa9-b90acd651c81 response_code = 200 uri = /v2p
26542024-11-14T06:26:30.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53525 req_id = a5b952f1-8b96-42ee-83c4-28dfe725777a response_code = 200 uri = /network-bootstore-config
26552024-11-14T06:26:30.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33455
26562024-11-14T06:26:30.219ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26572024-11-14T06:26:30.257ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26582024-11-14T06:26:30.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97625 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33455 req_id = a7cc399c-da0c-4f10-9b3c-637c832e565b response_code = 204 uri = /switch-ports
26592024-11-14T06:26:30.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33455 req_id = 3c45c9b9-4432-4a9c-88d9-ba4ef3d99065 response_code = 200 uri = /network-bootstore-config
26602024-11-14T06:26:41.502ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56529
26612024-11-14T06:26:41.502ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56529 req_id = ac0030cc-e01e-4cb1-a9de-1bc9ade3378b response_code = 200 uri = /baseboard
26622024-11-14T06:26:59.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37820
26632024-11-14T06:26:59.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37820 req_id = 7bf39f3d-b8d3-40a6-9db1-ff308697adf2 response_code = 200 uri = /vpc-routes
26642024-11-14T06:26:59.716ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
26652024-11-14T06:26:59.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37820 req_id = 17ca9965-c965-45d6-8662-a9aca71f6c89 response_code = 204 uri = /eip-gateways
26662024-11-14T06:26:59.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59086
26672024-11-14T06:26:59.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59086 req_id = 122e77fe-3974-4f38-be1c-152535109e19 response_code = 200 uri = /v2p
26682024-11-14T06:26:59.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37820 req_id = d09947d1-13d1-479e-98bc-8c4a2d80ae47 response_code = 204 uri = /vpc-routes
26692024-11-14T06:26:59.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58673
26702024-11-14T06:26:59.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58673 req_id = e2088f57-3cda-4e82-9883-bbdb2ac61b9e response_code = 200 uri = /vpc-routes
26712024-11-14T06:26:59.803ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
26722024-11-14T06:26:59.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58673 req_id = fc28b501-3827-4817-82ae-483ab3a7dd0b response_code = 204 uri = /eip-gateways
26732024-11-14T06:26:59.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62761
26742024-11-14T06:26:59.810ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26752024-11-14T06:26:59.852ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26762024-11-14T06:26:59.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104312 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62761 req_id = 1e945053-579d-4a90-b29a-224ef22a8287 response_code = 204 uri = /switch-ports
26772024-11-14T06:26:59.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47452
26782024-11-14T06:26:59.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60254
26792024-11-14T06:26:59.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56816
26802024-11-14T06:26:59.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43697
26812024-11-14T06:26:59.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47921
26822024-11-14T06:26:59.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 422 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62761 req_id = 609e2c1f-9038-49c6-ae17-dedc2a6b03a6 response_code = 200 uri = /network-bootstore-config
26832024-11-14T06:26:59.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47452 req_id = 96222163-794b-4720-bff5-c2262fe815df response_code = 200 uri = /vpc-routes
26842024-11-14T06:26:59.915ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26852024-11-14T06:26:59.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47921 req_id = 01eb1fc5-bfb4-4d2e-9dd5-0f9b08a8b5db response_code = 200 uri = /v2p
26862024-11-14T06:26:59.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4484 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56816 req_id = 77302972-f7d9-4d69-86be-2fd08994567f response_code = 200 uri = /v2p
26872024-11-14T06:26:59.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4769 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58673 req_id = 4dc3083d-360f-488a-899d-bfd0ad1f379c response_code = 204 uri = /vpc-routes
26882024-11-14T06:26:59.954ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26892024-11-14T06:26:59.958ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
26902024-11-14T06:26:59.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47452 req_id = 944df02b-94b2-4a02-9df2-ae88d9f53288 response_code = 204 uri = /eip-gateways
26912024-11-14T06:26:59.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 605 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47452 req_id = 617de5d5-16c7-487b-b3af-471575897fa8 response_code = 204 uri = /vpc-routes
26922024-11-14T06:27:00.011ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26932024-11-14T06:27:00.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96227 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43697 req_id = 1cd05c49-63cf-4303-87f2-36b9735ebd21 response_code = 204 uri = /switch-ports
26942024-11-14T06:27:00.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 745 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43697 req_id = 3cef37f6-98ef-4202-843c-aff1431369c1 response_code = 200 uri = /network-bootstore-config
26952024-11-14T06:27:00.051ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26962024-11-14T06:27:00.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192349 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60254 req_id = ecc1d6e2-7167-482f-bbb3-4d5fe2f27a3c response_code = 204 uri = /switch-ports
26972024-11-14T06:27:00.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60254 req_id = 0c5fcf71-34c4-401f-bf34-b7405532837b response_code = 200 uri = /network-bootstore-config
26982024-11-14T06:27:11.536ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37842
26992024-11-14T06:27:11.536ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37842 req_id = e8506ad0-966e-4e9b-8c32-6bf75653de23 response_code = 200 uri = /baseboard
27002024-11-14T06:27:29.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59810
27012024-11-14T06:27:29.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59810 req_id = 014c8f19-dbb5-4162-85fe-8746f17eb602 response_code = 200 uri = /vpc-routes
27022024-11-14T06:27:29.764ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
27032024-11-14T06:27:29.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59810 req_id = 2d7d34a2-0265-47aa-8c58-ba8c4c9f8b9a response_code = 204 uri = /eip-gateways
27042024-11-14T06:27:29.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39141
27052024-11-14T06:27:29.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39141 req_id = b968fd4c-673f-4a0b-8277-122a45a3a8d1 response_code = 200 uri = /v2p
27062024-11-14T06:27:29.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59810 req_id = 1b99854b-0e8c-49da-92f2-a0bcf864205f response_code = 204 uri = /vpc-routes
27072024-11-14T06:27:29.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36517
27082024-11-14T06:27:29.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36517 req_id = 63d4c1d7-b384-4ffc-a5b6-0d699b8e5f98 response_code = 200 uri = /vpc-routes
27092024-11-14T06:27:29.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51082
27102024-11-14T06:27:29.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51082 req_id = 744924ba-3131-4eb8-bd28-e335bfab4e29 response_code = 200 uri = /v2p
27112024-11-14T06:27:29.909ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
27122024-11-14T06:27:29.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36517 req_id = 1c1c027f-202c-4a67-808c-c1156b2b0884 response_code = 204 uri = /eip-gateways
27132024-11-14T06:27:29.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36517 req_id = e33bb584-eb83-42dd-a17f-d729e58d1c0b response_code = 204 uri = /vpc-routes
27142024-11-14T06:27:29.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59203
27152024-11-14T06:27:29.965ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27162024-11-14T06:27:30.007ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27172024-11-14T06:27:30.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104237 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59203 req_id = 83e67dc5-e692-40a0-8e5e-25a10861a442 response_code = 204 uri = /switch-ports
27182024-11-14T06:27:30.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45617
27192024-11-14T06:27:30.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40097
27202024-11-14T06:27:30.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45591
27212024-11-14T06:27:30.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45591 req_id = dec6dd9b-4b4a-44f2-9dbf-4eaf5693aaf0 response_code = 200 uri = /vpc-routes
27222024-11-14T06:27:30.070ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27232024-11-14T06:27:30.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 401 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59203 req_id = a1402363-c0e4-4edc-8b20-097a99f07c41 response_code = 200 uri = /network-bootstore-config
27242024-11-14T06:27:30.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40097 req_id = 5d738d76-2a9b-450a-8ce1-b93b49e4e5bd response_code = 200 uri = /v2p
27252024-11-14T06:27:30.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44015
27262024-11-14T06:27:30.111ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27272024-11-14T06:27:30.115ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
27282024-11-14T06:27:30.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 535 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45591 req_id = 8aed1189-45c4-4ef0-a09f-0f85940279de response_code = 204 uri = /eip-gateways
27292024-11-14T06:27:30.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 547 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45591 req_id = a54be50a-4383-4e77-974b-6236d01aa0c3 response_code = 204 uri = /vpc-routes
27302024-11-14T06:27:30.169ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27312024-11-14T06:27:30.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98589 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45617 req_id = 9d303910-b2a3-455a-be47-c5bcc24dec7b response_code = 204 uri = /switch-ports
27322024-11-14T06:27:30.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 679 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45617 req_id = 0e15a741-5bfd-41ac-a4cc-048aa6247eb4 response_code = 200 uri = /network-bootstore-config
27332024-11-14T06:27:30.204ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27342024-11-14T06:27:30.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183289 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44015 req_id = 02fc2265-77a6-4f9d-90bc-0aa2028b1e59 response_code = 204 uri = /switch-ports
27352024-11-14T06:27:30.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44015 req_id = 31f416c0-9bd3-4f57-bfc2-a053fe3ae534 response_code = 200 uri = /network-bootstore-config
27362024-11-14T06:27:41.573ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62889
27372024-11-14T06:27:41.573ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62889 req_id = f57daf80-76d0-472a-887f-1d3167edffd5 response_code = 200 uri = /baseboard
27382024-11-14T06:27:59.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36970
27392024-11-14T06:27:59.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36970 req_id = 35c9a649-d098-49fc-8882-d44c0f2ea9a6 response_code = 200 uri = /vpc-routes
27402024-11-14T06:27:59.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59567
27412024-11-14T06:27:59.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59567 req_id = 5a9b730f-de50-4180-9472-82b783e595cb response_code = 200 uri = /vpc-routes
27422024-11-14T06:27:59.666ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
27432024-11-14T06:27:59.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59567 req_id = 36398672-e474-418a-aeaf-b61062835f5f response_code = 204 uri = /eip-gateways
27442024-11-14T06:27:59.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59567 req_id = 38b7cfeb-2337-4313-a953-66237952886b response_code = 204 uri = /vpc-routes
27452024-11-14T06:27:59.697ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
27462024-11-14T06:27:59.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36970 req_id = 9d5b2566-b7be-4bcd-88ac-aa6924ba7b3b response_code = 204 uri = /eip-gateways
27472024-11-14T06:27:59.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36970 req_id = 1dd5a895-b9fc-46dd-8d72-fd23991212b3 response_code = 204 uri = /vpc-routes
27482024-11-14T06:27:59.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39771
27492024-11-14T06:27:59.728ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27502024-11-14T06:27:59.775ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27512024-11-14T06:27:59.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115306 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39771 req_id = 37f3e1fb-513c-4afe-aba7-47fec82d6e2f response_code = 204 uri = /switch-ports
27522024-11-14T06:27:59.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53893
27532024-11-14T06:27:59.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40575
27542024-11-14T06:27:59.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48466
27552024-11-14T06:27:59.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40550
27562024-11-14T06:27:59.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40550 req_id = a79f2fea-50fd-496b-988b-e1b99233ed04 response_code = 200 uri = /v2p
27572024-11-14T06:27:59.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39771 req_id = 2fbdb606-569a-47c0-82ec-fd34b0a6ca9e response_code = 200 uri = /network-bootstore-config
27582024-11-14T06:27:59.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48466 req_id = 30147ee3-0e20-4b6a-8965-0b704062f4fe response_code = 200 uri = /vpc-routes
27592024-11-14T06:27:59.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40575 req_id = e52b7e32-374f-40c0-9052-1ffa51fcaefe response_code = 200 uri = /v2p
27602024-11-14T06:27:59.844ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27612024-11-14T06:27:59.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42861
27622024-11-14T06:27:59.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42861 req_id = ef253e0e-31e9-4aae-a802-877d409f9beb response_code = 200 uri = /v2p
27632024-11-14T06:27:59.858ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
27642024-11-14T06:27:59.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48466 req_id = 18f10fb5-56ad-4382-a810-b560f221fe65 response_code = 204 uri = /eip-gateways
27652024-11-14T06:27:59.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48466 req_id = e5468964-7eca-437a-b72a-f40b90bb1db6 response_code = 204 uri = /vpc-routes
27662024-11-14T06:27:59.886ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27672024-11-14T06:27:59.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56711
27682024-11-14T06:27:59.945ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27692024-11-14T06:27:59.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101579 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53893 req_id = 23168675-3086-47b1-a620-62f5b97b6d50 response_code = 204 uri = /switch-ports
27702024-11-14T06:27:59.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 655 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53893 req_id = d30a6a11-ede7-4be6-98dd-56525af16f5e response_code = 200 uri = /network-bootstore-config
27712024-11-14T06:27:59.982ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27722024-11-14T06:28:00.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149808 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56711 req_id = a5d9ceca-5c28-4f08-9267-7cef3ac5c0f1 response_code = 204 uri = /switch-ports
27732024-11-14T06:28:00.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56711 req_id = 79a03574-d913-49ed-a5e3-7a38ed0113ea response_code = 200 uri = /network-bootstore-config
27742024-11-14T06:28:11.605ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39392
27752024-11-14T06:28:11.605ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39392 req_id = 7df460a1-b37e-43c7-85a9-0966f0eb04a6 response_code = 200 uri = /baseboard
27762024-11-14T06:28:29.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34689
27772024-11-14T06:28:29.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34689 req_id = bcdddd2d-c075-4d0d-a629-ec8a8164607b response_code = 200 uri = /vpc-routes
27782024-11-14T06:28:29.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65132
27792024-11-14T06:28:29.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65132 req_id = 958141e4-10a6-43b0-96f6-5acb9ba4448c response_code = 200 uri = /vpc-routes
27802024-11-14T06:28:29.876ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
27812024-11-14T06:28:29.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34689 req_id = 6817170e-a789-447a-8db7-bcb2caf36046 response_code = 204 uri = /eip-gateways
27822024-11-14T06:28:29.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34689 req_id = 75233567-af6a-4b25-a90d-a780eca0fb5d response_code = 204 uri = /vpc-routes
27832024-11-14T06:28:29.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62374
27842024-11-14T06:28:29.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62374 req_id = 2ccdfb11-a6ce-4352-acdd-8b7b790c5da3 response_code = 200 uri = /vpc-routes
27852024-11-14T06:28:29.899ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
27862024-11-14T06:28:29.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65132 req_id = b143d329-3a73-465b-9aa7-e249bcf53d80 response_code = 204 uri = /eip-gateways
27872024-11-14T06:28:29.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65132 req_id = 78dacfd4-de03-459f-a01e-82348cf9d035 response_code = 204 uri = /vpc-routes
27882024-11-14T06:28:29.962ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
27892024-11-14T06:28:29.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62374 req_id = df56eb47-61b3-452b-b5e2-d176d335bda7 response_code = 204 uri = /eip-gateways
27902024-11-14T06:28:29.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58773
27912024-11-14T06:28:29.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58773 req_id = 4d8618bb-8f93-4710-85d3-e9c586158887 response_code = 200 uri = /v2p
27922024-11-14T06:28:30.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32992
27932024-11-14T06:28:30.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32992 req_id = c99123b6-a0e8-42c9-9336-60db6dfcac5e response_code = 200 uri = /v2p
27942024-11-14T06:28:30.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62374 req_id = dbecbbb7-e091-48e5-9eab-3767561c01af response_code = 204 uri = /vpc-routes
27952024-11-14T06:28:30.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40763
27962024-11-14T06:28:30.033ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27972024-11-14T06:28:30.086ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27982024-11-14T06:28:30.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114674 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40763 req_id = 01f03325-ed97-4f55-85cd-1b097ba5ace4 response_code = 204 uri = /switch-ports
27992024-11-14T06:28:30.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48077
28002024-11-14T06:28:30.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49572
28012024-11-14T06:28:30.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60367
28022024-11-14T06:28:30.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40763 req_id = fe0fee0a-fc2c-4abe-a624-9c56d88aa511 response_code = 200 uri = /network-bootstore-config
28032024-11-14T06:28:30.148ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28042024-11-14T06:28:30.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48077 req_id = a982b233-de76-45e1-bc49-99d1869d3a30 response_code = 200 uri = /v2p
28052024-11-14T06:28:30.186ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28062024-11-14T06:28:30.247ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28072024-11-14T06:28:30.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99017 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60367 req_id = be8b744d-1adb-476b-a870-6cc1d54cc4df response_code = 204 uri = /switch-ports
28082024-11-14T06:28:30.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 740 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60367 req_id = 428da733-bfeb-42b4-b262-80a4a43c2118 response_code = 200 uri = /network-bootstore-config
28092024-11-14T06:28:30.284ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28102024-11-14T06:28:30.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191679 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49572 req_id = 2f33a50d-93f9-4342-9daf-7f0bea530183 response_code = 204 uri = /switch-ports
28112024-11-14T06:28:30.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49572 req_id = e95164a1-da61-4072-ae82-3ce8850b5f31 response_code = 200 uri = /network-bootstore-config
28122024-11-14T06:28:41.639ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63700
28132024-11-14T06:28:41.639ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63700 req_id = 529ed8f5-803d-4678-a4d9-fd65081f4d82 response_code = 200 uri = /baseboard
28142024-11-14T06:28:59.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65067
28152024-11-14T06:28:59.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65067 req_id = 42d12d1f-0d38-40e3-98f2-3c9544f21dbb response_code = 200 uri = /vpc-routes
28162024-11-14T06:28:59.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51975
28172024-11-14T06:28:59.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51975 req_id = e23586ee-c4e8-4b18-ba52-c8d7e486ef3d response_code = 200 uri = /vpc-routes
28182024-11-14T06:28:59.648ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
28192024-11-14T06:28:59.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65067 req_id = ca7a809b-5b67-4976-9e0f-3f3c3f2b3936 response_code = 204 uri = /eip-gateways
28202024-11-14T06:28:59.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65067 req_id = 64869c72-9716-43ea-bcbb-c50d690c45bf response_code = 204 uri = /vpc-routes
28212024-11-14T06:28:59.684ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
28222024-11-14T06:28:59.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51975 req_id = 8259d0c5-6939-4d6a-ae53-2b573e236155 response_code = 204 uri = /eip-gateways
28232024-11-14T06:28:59.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51975 req_id = c9d3a35a-ebd9-4bf6-9bcc-a0c51710ac24 response_code = 204 uri = /vpc-routes
28242024-11-14T06:28:59.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33618
28252024-11-14T06:28:59.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33618 req_id = 0965f8be-3b86-4881-81cf-9fe4f205e529 response_code = 200 uri = /v2p
28262024-11-14T06:28:59.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43412
28272024-11-14T06:28:59.739ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28282024-11-14T06:28:59.783ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28292024-11-14T06:28:59.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100680 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43412 req_id = 056b2d48-5944-42a3-b866-4961403aff45 response_code = 204 uri = /switch-ports
28302024-11-14T06:28:59.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38922
28312024-11-14T06:28:59.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49175
28322024-11-14T06:28:59.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55154
28332024-11-14T06:28:59.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55154 req_id = c76c32b3-3747-4c25-b3a5-34868d093706 response_code = 200 uri = /vpc-routes
28342024-11-14T06:28:59.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43412 req_id = ca406399-45ca-45eb-bb9d-025c373e02aa response_code = 200 uri = /network-bootstore-config
28352024-11-14T06:28:59.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38922 req_id = 186f473c-2014-4614-84f4-0c1d41b03b91 response_code = 200 uri = /v2p
28362024-11-14T06:28:59.841ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28372024-11-14T06:28:59.860ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
28382024-11-14T06:28:59.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 621 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55154 req_id = 1f857e67-b8e3-43d8-823b-bf140523d6f2 response_code = 204 uri = /eip-gateways
28392024-11-14T06:28:59.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40993
28402024-11-14T06:28:59.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40993 req_id = 8faa7f6e-52ff-48b0-9a69-8095e924ac3f response_code = 200 uri = /v2p
28412024-11-14T06:28:59.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 526 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55154 req_id = 3a6ae7ed-96bd-4b77-9fbf-495924031792 response_code = 204 uri = /vpc-routes
28422024-11-14T06:28:59.883ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28432024-11-14T06:28:59.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40162
28442024-11-14T06:28:59.941ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28452024-11-14T06:28:59.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100237 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49175 req_id = 65e3c77c-7bcb-4eb2-85d4-9610d48f1bd1 response_code = 204 uri = /switch-ports
28462024-11-14T06:28:59.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 760 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49175 req_id = 2b032943-5717-4a64-9307-ce2be5263242 response_code = 200 uri = /network-bootstore-config
28472024-11-14T06:28:59.980ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28482024-11-14T06:29:00.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106976 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40162 req_id = a0c70d3b-b866-4eeb-b026-7b3ea9d3cf4c response_code = 204 uri = /switch-ports
28492024-11-14T06:29:00.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40162 req_id = f60009da-c999-40be-b6a1-be9a58fc49ad response_code = 200 uri = /network-bootstore-config
28502024-11-14T06:29:11.671ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37446
28512024-11-14T06:29:11.672ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37446 req_id = 8ce7fc95-5643-4f37-b3f0-6abb80568b3f response_code = 200 uri = /baseboard
28522024-11-14T06:29:24.446ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
28532024-11-14T06:29:24.446ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
28542024-11-14T06:29:29.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58995
28552024-11-14T06:29:29.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58995 req_id = 0a35aaa4-6d8d-4a12-abe9-d9054cf51673 response_code = 200 uri = /vpc-routes
28562024-11-14T06:29:29.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44147
28572024-11-14T06:29:29.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44147 req_id = 2bb98598-33d4-416e-a9b6-db602b7333ee response_code = 200 uri = /vpc-routes
28582024-11-14T06:29:29.875ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
28592024-11-14T06:29:29.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58995 req_id = 08eeaf46-a750-4056-8076-ac34cc87b4bc response_code = 204 uri = /eip-gateways
28602024-11-14T06:29:29.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58995 req_id = 74da74a7-8aa0-45e7-ab69-d819eda8eff1 response_code = 204 uri = /vpc-routes
28612024-11-14T06:29:29.893ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
28622024-11-14T06:29:29.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44147 req_id = e14a9017-2f73-452f-a824-b5cace72ddbd response_code = 204 uri = /eip-gateways
28632024-11-14T06:29:29.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44147 req_id = f36031aa-43e4-4c90-ad2b-ac7d7e6895ea response_code = 204 uri = /vpc-routes
28642024-11-14T06:29:30.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43359
28652024-11-14T06:29:30.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43359 req_id = 315653c0-875b-47f3-bca3-393ba52433de response_code = 200 uri = /v2p
28662024-11-14T06:29:30.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59918
28672024-11-14T06:29:30.014ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28682024-11-14T06:29:30.069ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28692024-11-14T06:29:30.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135584 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59918 req_id = 235b3a0c-c897-4bf9-b91f-66843de01563 response_code = 204 uri = /switch-ports
28702024-11-14T06:29:30.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63859
28712024-11-14T06:29:30.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36568
28722024-11-14T06:29:30.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50341
28732024-11-14T06:29:30.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51921
28742024-11-14T06:29:30.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37124
28752024-11-14T06:29:30.150ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28762024-11-14T06:29:30.150ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28772024-11-14T06:29:30.150ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28782024-11-14T06:29:30.150ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/omicron-zones.json file = common/src/ledger.rs:177
28792024-11-14T06:29:30.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5637 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59918 req_id = 2e3afcc7-d91f-4dbf-8248-b4d4ee1a6d48 response_code = 200 uri = /network-bootstore-config
28802024-11-14T06:29:30.156ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28812024-11-14T06:29:30.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5845 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36568 req_id = 1b1e7794-2e89-4e55-8502-fa556031d6a8 response_code = 200 uri = /vpc-routes
28822024-11-14T06:29:30.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6005 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63859 req_id = fdfe5c5f-c9df-4be3-be94-9fea3e3f9f92 response_code = 200 uri = /v2p
28832024-11-14T06:29:30.157ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/omicron-zones.json file = common/src/ledger.rs:177
28842024-11-14T06:29:30.172ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28852024-11-14T06:29:30.172ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3687329d-db08-4cdf-99f1-652e017f6592
28862024-11-14T06:29:30.190ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28872024-11-14T06:29:30.190ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/omicron-zones.json file = common/src/ledger.rs:177
28882024-11-14T06:29:30.196ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/omicron-zones.json file = common/src/ledger.rs:177
28892024-11-14T06:29:30.199ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28902024-11-14T06:29:30.207ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28912024-11-14T06:29:30.207ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3
28922024-11-14T06:29:30.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61822
28932024-11-14T06:29:30.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61822 req_id = 99720339-0907-4ff7-b234-5f42be3f9e3e response_code = 200 uri = /v2p
28942024-11-14T06:29:30.224ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28952024-11-14T06:29:30.224ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3687329d-db08-4cdf-99f1-652e017f6592
28962024-11-14T06:29:30.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65201
28972024-11-14T06:29:30.259ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28982024-11-14T06:29:30.260ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3
28992024-11-14T06:29:30.267ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
29002024-11-14T06:29:30.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 589 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36568 req_id = 72086ae4-e5ab-424e-827f-f1f21deeba72 response_code = 204 uri = /eip-gateways
29012024-11-14T06:29:30.279ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29022024-11-14T06:29:30.279ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae
29032024-11-14T06:29:30.290ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29042024-11-14T06:29:30.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140976 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51921 req_id = 36a3d223-21ec-4cb2-b6d0-c3be837037ec response_code = 204 uri = /switch-ports
29052024-11-14T06:29:30.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12906 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36568 req_id = 7b41ba75-f430-46eb-8108-6ae15c679674 response_code = 204 uri = /vpc-routes
29062024-11-14T06:29:30.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 697 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51921 req_id = 5e92f36a-9f32-43de-8991-03a37a2a58b8 response_code = 200 uri = /network-bootstore-config
29072024-11-14T06:29:30.303ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29082024-11-14T06:29:30.303ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae
29092024-11-14T06:29:30.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56624
29102024-11-14T06:29:30.324ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29112024-11-14T06:29:30.324ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73
29122024-11-14T06:29:30.336ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29132024-11-14T06:29:30.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29142024-11-14T06:29:30.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29152024-11-14T06:29:30.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29162024-11-14T06:29:30.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29172024-11-14T06:29:30.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29182024-11-14T06:29:30.336ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
29192024-11-14T06:29:30.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 658 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56624 req_id = db0a3427-9d63-417c-9a49-dbaa1f104689 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29202024-11-14T06:29:30.340ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29212024-11-14T06:29:30.340ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73
29222024-11-14T06:29:30.345ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29232024-11-14T06:29:30.368ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29242024-11-14T06:29:30.368ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374
29252024-11-14T06:29:30.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46752
29262024-11-14T06:29:30.384ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29272024-11-14T06:29:30.384ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374
29282024-11-14T06:29:30.387ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29292024-11-14T06:29:30.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29302024-11-14T06:29:30.391ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29312024-11-14T06:29:30.391ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29322024-11-14T06:29:30.391ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29332024-11-14T06:29:30.391ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29342024-11-14T06:29:30.391ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
29352024-11-14T06:29:30.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46752 req_id = 4e210eca-56d3-4827-8151-52e4d6952006 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29362024-11-14T06:29:30.401ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29372024-11-14T06:29:30.401ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4ce86c2f-d73a-421e-8735-58bc8979e498
29382024-11-14T06:29:30.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62736
29392024-11-14T06:29:30.407ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29402024-11-14T06:29:30.407ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29412024-11-14T06:29:30.407ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29422024-11-14T06:29:30.407ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29432024-11-14T06:29:30.407ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29442024-11-14T06:29:30.407ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29452024-11-14T06:29:30.407ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
29462024-11-14T06:29:30.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 499 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62736 req_id = f5827291-474d-4902-b443-fac48d99eb62 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29472024-11-14T06:29:30.415ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29482024-11-14T06:29:30.415ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4ce86c2f-d73a-421e-8735-58bc8979e498
29492024-11-14T06:29:30.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188905 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65201 req_id = 4fe43718-1609-48fb-b667-fb3415b32631 response_code = 204 uri = /switch-ports
29502024-11-14T06:29:30.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65201 req_id = 25c0a885-a311-4e12-b51a-010831943584 response_code = 200 uri = /network-bootstore-config
29512024-11-14T06:29:30.441ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29522024-11-14T06:29:30.441ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_93a2b028-0235-4af9-913d-cd3caeb886d5
29532024-11-14T06:29:30.453ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29542024-11-14T06:29:30.453ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_93a2b028-0235-4af9-913d-cd3caeb886d5
29552024-11-14T06:29:30.469ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29562024-11-14T06:29:30.469ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_195bff2e-21e5-469e-88de-7266b55e8b12
29572024-11-14T06:29:30.484ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29582024-11-14T06:29:30.484ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_195bff2e-21e5-469e-88de-7266b55e8b12
29592024-11-14T06:29:30.501ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29602024-11-14T06:29:30.501ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f
29612024-11-14T06:29:30.515ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29622024-11-14T06:29:30.515ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f
29632024-11-14T06:29:30.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 371358 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37124 req_id = b0806825-fb64-492d-975d-708f680b5632 response_code = 200 uri = /inventory
29642024-11-14T06:29:30.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 376552 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50341 req_id = cc7a1fab-8929-4890-b67e-d1b61ec9a35a response_code = 200 uri = /inventory
29652024-11-14T06:29:31.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36501
29662024-11-14T06:29:31.170ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29672024-11-14T06:29:31.170ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29682024-11-14T06:29:31.170ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/9689d903-825b-4779-be70-9f8994af1ce1/config/omicron-zones.json file = common/src/ledger.rs:177
29692024-11-14T06:29:31.170ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/config/omicron-zones.json file = common/src/ledger.rs:177
29702024-11-14T06:29:31.184ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3687329d-db08-4cdf-99f1-652e017f6592 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29712024-11-14T06:29:31.184ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3687329d-db08-4cdf-99f1-652e017f6592
29722024-11-14T06:29:31.215ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5c2206db-33a4-45a1-93a5-5543ab4fefe3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29732024-11-14T06:29:31.215ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5c2206db-33a4-45a1-93a5-5543ab4fefe3
29742024-11-14T06:29:31.240ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3daa5fa9-1f5a-4fb6-b198-f46843f6caae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29752024-11-14T06:29:31.240ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3daa5fa9-1f5a-4fb6-b198-f46843f6caae
29762024-11-14T06:29:31.270ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ac1114a0-bdf6-4939-8af4-fb3fb61d8c73 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29772024-11-14T06:29:31.270ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ac1114a0-bdf6-4939-8af4-fb3fb61d8c73
29782024-11-14T06:29:31.301ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29792024-11-14T06:29:31.302ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad807d5e-9724-4b8a-bcac-1d8b8e2fa374
29802024-11-14T06:29:31.336ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4ce86c2f-d73a-421e-8735-58bc8979e498 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29812024-11-14T06:29:31.336ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4ce86c2f-d73a-421e-8735-58bc8979e498
29822024-11-14T06:29:31.368ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93a2b028-0235-4af9-913d-cd3caeb886d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29832024-11-14T06:29:31.368ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_93a2b028-0235-4af9-913d-cd3caeb886d5
29842024-11-14T06:29:31.397ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 195bff2e-21e5-469e-88de-7266b55e8b12 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29852024-11-14T06:29:31.397ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_195bff2e-21e5-469e-88de-7266b55e8b12
29862024-11-14T06:29:31.430ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad99b41b-bddf-41c4-a707-9a9d5f683a3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29872024-11-14T06:29:31.430ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ad99b41b-bddf-41c4-a707-9a9d5f683a3f
29882024-11-14T06:29:31.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276982 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36501 req_id = 275ddcf5-44f4-44d0-9133-37ebddec6897 response_code = 200 uri = /inventory
29892024-11-14T06:29:34.445ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
29902024-11-14T06:29:34.446ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
29912024-11-14T06:29:34.449ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
29922024-11-14T06:29:34.450ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
29932024-11-14T06:29:34.886ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
29942024-11-14T06:29:41.705ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54625
29952024-11-14T06:29:41.705ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54625 req_id = b87eb905-332c-4d48-bc04-12f24e17dd8c response_code = 200 uri = /baseboard
29962024-11-14T06:29:44.448ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
29972024-11-14T06:29:44.450ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
29982024-11-14T06:29:44.453ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
29992024-11-14T06:29:44.454ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30002024-11-14T06:29:54.452ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30012024-11-14T06:29:54.454ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30022024-11-14T06:29:54.457ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30032024-11-14T06:29:54.459ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30042024-11-14T06:29:59.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49688
30052024-11-14T06:29:59.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49688 req_id = 1f187ac1-b35a-4e75-b340-4f9a12483a70 response_code = 200 uri = /vpc-routes
30062024-11-14T06:29:59.669ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
30072024-11-14T06:29:59.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49688 req_id = 43e2d0ad-ef7c-4b1b-b129-a64bf9485c6f response_code = 204 uri = /eip-gateways
30082024-11-14T06:29:59.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49307
30092024-11-14T06:29:59.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49307 req_id = cfb24b95-0dc1-484d-8697-5738b09659f5 response_code = 200 uri = /vpc-routes
30102024-11-14T06:29:59.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49688 req_id = 92bb5a86-a4f6-477e-b639-f3a7df51d54b response_code = 204 uri = /vpc-routes
30112024-11-14T06:29:59.715ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
30122024-11-14T06:29:59.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49307 req_id = 239c6116-a0d5-4155-9103-b11099bd57e5 response_code = 204 uri = /eip-gateways
30132024-11-14T06:29:59.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49307 req_id = e988bc30-e748-4cc7-a578-440b452156df response_code = 204 uri = /vpc-routes
30142024-11-14T06:29:59.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46307
30152024-11-14T06:29:59.750ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30162024-11-14T06:29:59.794ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30172024-11-14T06:29:59.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104710 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46307 req_id = d73d36a0-cca3-4162-92c5-d82e1331b376 response_code = 204 uri = /switch-ports
30182024-11-14T06:29:59.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45074
30192024-11-14T06:29:59.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36054
30202024-11-14T06:29:59.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45529
30212024-11-14T06:29:59.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40486
30222024-11-14T06:29:59.855ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30232024-11-14T06:29:59.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3641 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45529 req_id = bc0308be-9e3d-485e-b76b-b940c830663e response_code = 200 uri = /v2p
30242024-11-14T06:29:59.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3757 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45074 req_id = 15dfab93-2084-47fb-839c-d8946deabe71 response_code = 200 uri = /v2p
30252024-11-14T06:29:59.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3737 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46307 req_id = 33434ea2-f966-495d-94ed-c9bd286ae12d response_code = 200 uri = /network-bootstore-config
30262024-11-14T06:29:59.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3764 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36054 req_id = 6b38dff7-2bb7-411e-93e8-316a00753921 response_code = 200 uri = /vpc-routes
30272024-11-14T06:29:59.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63703
30282024-11-14T06:29:59.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63703 req_id = 1e2f42c7-2904-485f-8de5-a64460925bc3 response_code = 200 uri = /v2p
30292024-11-14T06:29:59.890ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30302024-11-14T06:29:59.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45434
30312024-11-14T06:29:59.906ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
30322024-11-14T06:29:59.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 460 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36054 req_id = 5bcc2efd-39e5-4a0b-99a8-dc54cb1a281e response_code = 204 uri = /eip-gateways
30332024-11-14T06:29:59.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 464 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36054 req_id = 524334f7-ea2d-420b-a2c5-88c75f0605f7 response_code = 204 uri = /vpc-routes
30342024-11-14T06:29:59.949ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30352024-11-14T06:29:59.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93926 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40486 req_id = 79b57967-e423-4ba1-a89a-bd0542932083 response_code = 204 uri = /switch-ports
30362024-11-14T06:29:59.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 747 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40486 req_id = 560a6c8e-e2d2-41a5-adce-e188ff21b884 response_code = 200 uri = /network-bootstore-config
30372024-11-14T06:29:59.987ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30382024-11-14T06:30:00.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141579 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45434 req_id = c22e52a9-fe4c-45de-a1c2-31d1e6c89ea7 response_code = 204 uri = /switch-ports
30392024-11-14T06:30:00.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45434 req_id = 8d142a05-e55b-4595-964d-7d6941abfc5b response_code = 200 uri = /network-bootstore-config
30402024-11-14T06:30:04.456ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30412024-11-14T06:30:04.458ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30422024-11-14T06:30:04.461ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30432024-11-14T06:30:04.462ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30442024-11-14T06:30:11.738ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36673
30452024-11-14T06:30:11.738ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36673 req_id = 32c01f35-09ca-4acf-b50a-3f9d266d66fb response_code = 200 uri = /baseboard
30462024-11-14T06:30:14.461ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30472024-11-14T06:30:14.462ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30482024-11-14T06:30:14.465ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30492024-11-14T06:30:14.466ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30502024-11-14T06:30:24.464ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30512024-11-14T06:30:24.466ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30522024-11-14T06:30:24.468ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30532024-11-14T06:30:24.469ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30542024-11-14T06:30:29.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52541
30552024-11-14T06:30:29.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52541 req_id = 9c6c5ebf-d12f-4b90-8be3-0e6a4c35c704 response_code = 200 uri = /vpc-routes
30562024-11-14T06:30:29.683ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
30572024-11-14T06:30:29.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52541 req_id = 702bb3ed-d39d-4405-951b-4613cd5a4758 response_code = 204 uri = /eip-gateways
30582024-11-14T06:30:29.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52541 req_id = 4092a961-7702-4303-b7ff-2240392becd5 response_code = 204 uri = /vpc-routes
30592024-11-14T06:30:29.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55425
30602024-11-14T06:30:29.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55425 req_id = e9291bfd-695b-4cad-a0b8-a238c2036ed5 response_code = 200 uri = /vpc-routes
30612024-11-14T06:30:29.793ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
30622024-11-14T06:30:29.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55425 req_id = 5060aff3-ac3b-419a-86ac-9dd67b2692d4 response_code = 204 uri = /eip-gateways
30632024-11-14T06:30:29.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55425 req_id = 4ae29d28-4568-4b33-944a-baeb3bb540f6 response_code = 204 uri = /vpc-routes
30642024-11-14T06:30:29.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38076
30652024-11-14T06:30:29.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38076 req_id = b9ed1fdf-cc03-4779-942f-12c5e4089b80 response_code = 200 uri = /v2p
30662024-11-14T06:30:29.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40982
30672024-11-14T06:30:29.883ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30682024-11-14T06:30:29.926ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30692024-11-14T06:30:29.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108336 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40982 req_id = 05eb0a16-c73d-44b2-adb5-d7b6bd320513 response_code = 204 uri = /switch-ports
30702024-11-14T06:30:29.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33863
30712024-11-14T06:30:29.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33863 req_id = d1d08948-d1d3-4417-b0ca-69899f5fa93d response_code = 200 uri = /vpc-routes
30722024-11-14T06:30:29.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40982 req_id = a78be771-f720-49da-90e1-71b77096d087 response_code = 200 uri = /network-bootstore-config
30732024-11-14T06:30:30.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45161
30742024-11-14T06:30:30.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45161 req_id = b7e5563b-8c78-413d-ac4e-6c7bf7aadcee response_code = 200 uri = /v2p
30752024-11-14T06:30:30.039ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
30762024-11-14T06:30:30.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33863 req_id = 60c0b30a-28cd-4064-b662-804a4626b2fb response_code = 204 uri = /eip-gateways
30772024-11-14T06:30:30.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63419
30782024-11-14T06:30:30.041ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30792024-11-14T06:30:30.084ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30802024-11-14T06:30:30.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106275 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63419 req_id = 8516bbd4-2d68-4ec0-a3d1-1d999b34393e response_code = 204 uri = /switch-ports
30812024-11-14T06:30:30.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36425
30822024-11-14T06:30:30.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34247
30832024-11-14T06:30:30.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63419 req_id = e3d904b5-7039-47a1-82ee-098f7584e093 response_code = 200 uri = /network-bootstore-config
30842024-11-14T06:30:30.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 461 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33863 req_id = 56d36556-ef8b-4ea8-a0ad-80c6c2a3f0ce response_code = 204 uri = /vpc-routes
30852024-11-14T06:30:30.148ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30862024-11-14T06:30:30.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36425 req_id = 5af87d42-adbf-4f60-82d5-db904d4c7950 response_code = 200 uri = /v2p
30872024-11-14T06:30:30.188ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30882024-11-14T06:30:30.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99912 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34247 req_id = e0f5ed43-03a6-491c-91df-e482ad2d0ade response_code = 204 uri = /switch-ports
30892024-11-14T06:30:30.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34247 req_id = 962ca0ac-1d74-42d2-9fd1-f933b82a1475 response_code = 200 uri = /network-bootstore-config
30902024-11-14T06:30:34.468ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30912024-11-14T06:30:34.470ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30922024-11-14T06:30:34.473ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30932024-11-14T06:30:34.473ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30942024-11-14T06:30:41.772ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63372
30952024-11-14T06:30:41.772ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63372 req_id = f783ad61-6fdb-4c70-9e1b-d8f76d5974eb response_code = 200 uri = /baseboard
30962024-11-14T06:30:44.472ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30972024-11-14T06:30:44.474ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30982024-11-14T06:30:44.477ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
30992024-11-14T06:30:44.478ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31002024-11-14T06:30:54.477ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31012024-11-14T06:30:54.479ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31022024-11-14T06:30:54.482ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31032024-11-14T06:30:54.482ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31042024-11-14T06:30:59.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35960
31052024-11-14T06:30:59.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35960 req_id = 67e6f74c-1a12-49b4-bea5-1261a84435d2 response_code = 200 uri = /vpc-routes
31062024-11-14T06:30:59.644ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
31072024-11-14T06:30:59.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35960 req_id = 2ef1656f-9457-4462-83fe-98fff8fc7e1f response_code = 204 uri = /eip-gateways
31082024-11-14T06:30:59.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35960 req_id = 9df1cf66-fb14-4750-8d1e-10e676ad4f09 response_code = 204 uri = /vpc-routes
31092024-11-14T06:30:59.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56512
31102024-11-14T06:30:59.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56512 req_id = 55b0b978-f769-42e3-8368-ae8efce0232a response_code = 200 uri = /vpc-routes
31112024-11-14T06:30:59.735ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
31122024-11-14T06:30:59.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56512 req_id = 30252eee-6cbe-4339-ac56-17590602ee48 response_code = 204 uri = /eip-gateways
31132024-11-14T06:30:59.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56512 req_id = d9b53044-8af5-4ba6-a59e-72290a8089fc response_code = 204 uri = /vpc-routes
31142024-11-14T06:30:59.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34293
31152024-11-14T06:30:59.774ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31162024-11-14T06:30:59.825ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31172024-11-14T06:30:59.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125002 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34293 req_id = 3e9dc969-5e0d-4b95-838f-65b39927438e response_code = 204 uri = /switch-ports
31182024-11-14T06:30:59.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38865
31192024-11-14T06:30:59.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36164
31202024-11-14T06:30:59.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50933
31212024-11-14T06:30:59.899ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31222024-11-14T06:30:59.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5363 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50933 req_id = fcf6ae52-df11-4947-a2cd-e1a0afe4f05b response_code = 200 uri = /v2p
31232024-11-14T06:30:59.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5376 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34293 req_id = 64a319ef-6129-47c7-9f06-09ee53ab7d88 response_code = 200 uri = /network-bootstore-config
31242024-11-14T06:30:59.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5428 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36164 req_id = 29a67b6e-e39e-4615-8478-82f5ef5d38f0 response_code = 200 uri = /vpc-routes
31252024-11-14T06:30:59.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58915
31262024-11-14T06:30:59.945ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31272024-11-14T06:30:59.967ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
31282024-11-14T06:30:59.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36164 req_id = 7dc210cc-63af-4c92-9bdf-09a44b9dba57 response_code = 204 uri = /eip-gateways
31292024-11-14T06:30:59.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55334
31302024-11-14T06:30:59.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55334 req_id = bf520c7f-c254-4162-83cf-0e438245da9f response_code = 200 uri = /v2p
31312024-11-14T06:30:59.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42362
31322024-11-14T06:30:59.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42362 req_id = cda01c4f-60c1-44fe-822f-d28821552121 response_code = 200 uri = /v2p
31332024-11-14T06:31:00.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 897 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36164 req_id = cf38ce6e-a86a-468b-82a0-73d99b4ac262 response_code = 204 uri = /vpc-routes
31342024-11-14T06:31:00.011ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31352024-11-14T06:31:00.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112017 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38865 req_id = 3c436ea7-a7c9-47af-b4a5-37010e81f6dc response_code = 204 uri = /switch-ports
31362024-11-14T06:31:00.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 650 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38865 req_id = 202074a9-00c9-4cd7-9b3d-e3a1d68d1ed1 response_code = 200 uri = /network-bootstore-config
31372024-11-14T06:31:00.049ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31382024-11-14T06:31:00.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194706 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58915 req_id = 1eafcd0e-2bb1-475e-a666-51c6b403c84c response_code = 204 uri = /switch-ports
31392024-11-14T06:31:00.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58915 req_id = 4a4e6450-1c41-4a8a-a80c-10a74c047a11 response_code = 200 uri = /network-bootstore-config
31402024-11-14T06:31:04.481ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31412024-11-14T06:31:04.483ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31422024-11-14T06:31:04.486ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31432024-11-14T06:31:04.486ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31442024-11-14T06:31:11.810ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56086
31452024-11-14T06:31:11.810ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56086 req_id = a19d19ed-6fdc-45bb-8d96-5ed74df97f9d response_code = 200 uri = /baseboard
31462024-11-14T06:31:14.485ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31472024-11-14T06:31:14.487ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31482024-11-14T06:31:14.490ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31492024-11-14T06:31:14.490ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31502024-11-14T06:31:24.489ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31512024-11-14T06:31:24.490ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31522024-11-14T06:31:24.493ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31532024-11-14T06:31:24.494ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31542024-11-14T06:31:29.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38718
31552024-11-14T06:31:29.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38718 req_id = 42378945-f18a-4dff-a7d0-917c4594ced7 response_code = 200 uri = /vpc-routes
31562024-11-14T06:31:29.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40361
31572024-11-14T06:31:29.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40361 req_id = e1769272-3f24-4a89-ad8c-ac673a57d263 response_code = 200 uri = /vpc-routes
31582024-11-14T06:31:29.917ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
31592024-11-14T06:31:29.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38718 req_id = c55d502a-9d40-444a-8961-0337608889a0 response_code = 204 uri = /eip-gateways
31602024-11-14T06:31:29.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65526
31612024-11-14T06:31:29.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65526 req_id = cbe11572-62d0-45a4-9f8e-0b6bdaef6e0c response_code = 200 uri = /vpc-routes
31622024-11-14T06:31:29.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38718 req_id = eb7265ee-5a6c-4b6e-b74e-99a4eb7f0e74 response_code = 204 uri = /vpc-routes
31632024-11-14T06:31:29.946ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
31642024-11-14T06:31:29.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40361 req_id = e3324269-dc72-4c6e-9df5-fdbf04143334 response_code = 204 uri = /eip-gateways
31652024-11-14T06:31:29.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40361 req_id = 303c6150-0565-43a2-acd8-b6948d53e029 response_code = 204 uri = /vpc-routes
31662024-11-14T06:31:29.996ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
31672024-11-14T06:31:29.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65526 req_id = 4801fb75-0865-4cb1-933e-0951c3853815 response_code = 204 uri = /eip-gateways
31682024-11-14T06:31:30.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49764
31692024-11-14T06:31:30.005ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31702024-11-14T06:31:30.051ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31712024-11-14T06:31:30.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103025 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49764 req_id = 3f159683-1a27-48fd-a991-7c1764c5e37f response_code = 204 uri = /switch-ports
31722024-11-14T06:31:30.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39665
31732024-11-14T06:31:30.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49137
31742024-11-14T06:31:30.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47135
31752024-11-14T06:31:30.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65526 req_id = 542a6a74-154e-4ac7-8115-75f1620729c6 response_code = 204 uri = /vpc-routes
31762024-11-14T06:31:30.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49764 req_id = bc8daa00-45a8-4ef7-ab98-5ec8f716f15c response_code = 200 uri = /network-bootstore-config
31772024-11-14T06:31:30.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47135 req_id = c8724ae2-f887-4e7d-b13a-bb4f48e74084 response_code = 200 uri = /v2p
31782024-11-14T06:31:30.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39665 req_id = e7bc438d-dbf1-4ebb-b992-6c0eadd722fb response_code = 200 uri = /v2p
31792024-11-14T06:31:30.109ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31802024-11-14T06:31:30.150ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31812024-11-14T06:31:30.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53739
31822024-11-14T06:31:30.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46796
31832024-11-14T06:31:30.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46796 req_id = b1fd41b7-f177-4cff-aea1-89bffb6269eb response_code = 200 uri = /v2p
31842024-11-14T06:31:30.211ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31852024-11-14T06:31:30.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102464 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49137 req_id = 239492af-08d1-4ab8-85bc-daad9b0ca5dc response_code = 204 uri = /switch-ports
31862024-11-14T06:31:30.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 863 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49137 req_id = f07dd29a-ae57-4c03-a7c7-a8dc9190a3b7 response_code = 200 uri = /network-bootstore-config
31872024-11-14T06:31:30.249ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31882024-11-14T06:31:30.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136365 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53739 req_id = ed97547d-c0e2-4104-8ff9-dddef066bc0b response_code = 204 uri = /switch-ports
31892024-11-14T06:31:30.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53739 req_id = d208e9a5-3e2b-4ce9-a87a-b06f63a4803b response_code = 200 uri = /network-bootstore-config
31902024-11-14T06:31:34.492ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31912024-11-14T06:31:34.493ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31922024-11-14T06:31:34.496ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31932024-11-14T06:31:34.497ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
31942024-11-14T06:31:40.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53485
31952024-11-14T06:31:40.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53485 req_id = fbc3962d-a715-466b-945b-0d7ab619caf1 response_code = 200 uri = /v2p
31962024-11-14T06:31:40.643ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(748766) }
31972024-11-14T06:31:40.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1497 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53485 req_id = b578506a-523b-4126-8012-1cb98a576462 response_code = 204 uri = /v2p
31982024-11-14T06:31:40.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60787
31992024-11-14T06:31:40.707ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e512c863-a3a7-4159-b07b-5b9aed47edd2, kind: Instance { id: dc849cad-a863-4ceb-a084-716be6d12072 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(748766), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e512c863-a3a7-4159-b07b-5b9aed47edd2, kind: Instance { id: dc849cad-a863-4ceb-a084-716be6d12072 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(748766), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e512c863-a3a7-4159-b07b-5b9aed47edd2, kind: Instance { id: dc849cad-a863-4ceb-a084-716be6d12072 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(748766), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(748766))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e512c863-a3a7-4159-b07b-5b9aed47edd2, kind: Instance { id: dc849cad-a863-4ceb-a084-716be6d12072 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(748766), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-976fa6faf2e", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 8d8e4696-deca-4692-b9bd-972bfe7de0fe, read_only_parent: Some(Volume { block_size: 512, id: ca9ddfbc-b0af-4251-a18b-c8b277330137, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 3f7080f2-2012-486d-9dc3-28f8d8316e6f, key: Some("8kw8ERE0VAHTZ9YiftkljWDsCww4AK/AoG7b6fZhHEg="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::1a]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 8d8e4696-deca-4692-b9bd-972bfe7de0fe, key: Some("DzcXbMIRHdW7cmfqTCHKccHDtXB594XJ+XDp26TH6bQ="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::1a]:19002", "[fd00:1122:3344:101::13]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-976fa6faf2e" }] }), cloud_init_bytes: Some(..) } instance_id = dc849cad-a863-4ceb-a084-716be6d12072 metadata = InstanceMetadata { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, project_id: 7978c97d-b581-4db3-bff9-bea13b3ed4db } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-14T06:31:40.697905877Z }
32002024-11-14T06:31:40.707ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 migration_id = None propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32012024-11-14T06:31:40.707ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 migration_id = None propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e512c863-a3a7-4159-b07b-5b9aed47edd2, kind: Instance { id: dc849cad-a863-4ceb-a084-716be6d12072 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(748766), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e512c863-a3a7-4159-b07b-5b9aed47edd2, kind: Instance { id: dc849cad-a863-4ceb-a084-716be6d12072 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(748766), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e512c863-a3a7-4159-b07b-5b9aed47edd2, kind: Instance { id: dc849cad-a863-4ceb-a084-716be6d12072 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(748766), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(748766))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e512c863-a3a7-4159-b07b-5b9aed47edd2, kind: Instance { id: dc849cad-a863-4ceb-a084-716be6d12072 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(748766), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-976fa6faf2e", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 8d8e4696-deca-4692-b9bd-972bfe7de0fe, read_only_parent: Some(Volume { block_size: 512, id: ca9ddfbc-b0af-4251-a18b-c8b277330137, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 3f7080f2-2012-486d-9dc3-28f8d8316e6f, key: Some("8kw8ERE0VAHTZ9YiftkljWDsCww4AK/AoG7b6fZhHEg="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::1a]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 8d8e4696-deca-4692-b9bd-972bfe7de0fe, key: Some("DzcXbMIRHdW7cmfqTCHKccHDtXB594XJ+XDp26TH6bQ="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::1a]:19002", "[fd00:1122:3344:101::13]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-976fa6faf2e" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-14T06:31:40.697905877Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
32022024-11-14T06:31:40.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11827 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60787 req_id = 4dcafd58-384f-4597-970c-9e9206a1af3f response_code = 200 uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c
32032024-11-14T06:31:40.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52011
32042024-11-14T06:31:40.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 726 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52011 req_id = d3328415-7c6e-495a-99ef-129765f6ec91 response_code = 200 uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c/state
32052024-11-14T06:31:40.786ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 748766 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
32062024-11-14T06:31:40.786ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
32072024-11-14T06:31:40.828ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c file = illumos-utils/src/zone.rs:325 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32082024-11-14T06:31:40.852ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c file = illumos-utils/src/zone.rs:363 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32092024-11-14T06:31:40.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53036
32102024-11-14T06:31:40.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53036 req_id = 71273ad6-7646-4433-aca7-58fbee123eea response_code = 200 uri = /vpc-routes
32112024-11-14T06:31:40.876ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {e512c863-a3a7-4159-b07b-5b9aed47edd2: {10.151.2.175: {1c5c0270-8422-4f37-a051-530b9bd30aae}, 10.151.2.176: {1c5c0270-8422-4f37-a051-530b9bd30aae}}} }
32122024-11-14T06:31:41.845ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57857
32132024-11-14T06:31:41.845ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57857 req_id = 93aaf062-eae7-4fd9-ad11-2224c1a881f3 response_code = 200 uri = /baseboard
32142024-11-14T06:31:42.446ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32152024-11-14T06:31:42.447ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c zone file = illumos-utils/src/running_zone.rs:488 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c zone = oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c
32162024-11-14T06:31:42.650ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c") failed: Property not found. retry in 40.852973ms file = illumos-utils/src/svc.rs:36 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c zone = oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c
32172024-11-14T06:31:42.701ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c") failed: Property not found. retry in 100.108694ms file = illumos-utils/src/svc.rs:36 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c zone = oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c
32182024-11-14T06:31:42.822ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c") failed: Property not found. retry in 256.443291ms file = illumos-utils/src/svc.rs:36 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c zone = oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c
32192024-11-14T06:31:43.098ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c") failed: Property not found. retry in 291.315047ms file = illumos-utils/src/svc.rs:36 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c zone = oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c
32202024-11-14T06:31:43.406ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c") failed: Property not found. retry in 652.180296ms file = illumos-utils/src/svc.rs:36 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c zone = oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c
32212024-11-14T06:31:44.079ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c") failed: Property not found. retry in 880.041571ms file = illumos-utils/src/svc.rs:36 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c zone = oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c
32222024-11-14T06:31:44.497ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
32232024-11-14T06:31:44.498ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
32242024-11-14T06:31:44.501ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
32252024-11-14T06:31:44.502ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
32262024-11-14T06:31:44.971ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c") failed: Property not found. retry in 885.877818ms file = illumos-utils/src/svc.rs:36 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c zone = oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c
32272024-11-14T06:31:45.869ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c") failed: Property not found. retry in 1.353166789s file = illumos-utils/src/svc.rs:36 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c zone = oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c
32282024-11-14T06:31:47.238ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c") failed: Property not found. retry in 979.512508ms file = illumos-utils/src/svc.rs:36 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c zone = oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c
32292024-11-14T06:31:48.251ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c file = sled-agent/src/instance.rs:1787 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32302024-11-14T06:31:48.264ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32312024-11-14T06:31:48.301ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32322024-11-14T06:31:48.442ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32332024-11-14T06:31:48.443ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
32342024-11-14T06:31:48.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7566781 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53036 req_id = 7d0f28f1-a093-4f76-8a9d-a74de40a9d75 response_code = 204 uri = /eip-gateways
32352024-11-14T06:31:48.443ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-14T06:31:48.443857253Z } file = sled-agent/src/instance.rs:780 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32362024-11-14T06:31:48.443ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-14T06:31:48.443857253Z } propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32372024-11-14T06:31:48.443ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-14T06:31:48.443857253Z }, migration_in: None, migration_out: None }
32382024-11-14T06:31:48.511ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-14T06:31:48.511942970Z } file = sled-agent/src/instance.rs:780 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32392024-11-14T06:31:48.512ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-14T06:31:48.511942970Z } propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32402024-11-14T06:31:48.512ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-14T06:31:48.511942970Z }, migration_in: None, migration_out: None }
32412024-11-14T06:31:48.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 347 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53036 req_id = 47484a1d-2193-4be8-a643-2a0a8d2c04aa response_code = 204 uri = /vpc-routes
32422024-11-14T06:31:54.501ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
32432024-11-14T06:31:54.502ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
32442024-11-14T06:31:54.505ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
32452024-11-14T06:31:54.506ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
32462024-11-14T06:31:58.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43988
32472024-11-14T06:31:58.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 745 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43988 req_id = 3435ccb3-71da-4c6b-93ee-10034fadc813 response_code = 200 uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c/state
32482024-11-14T06:31:58.295ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-14T06:31:58.295440351Z } file = sled-agent/src/instance.rs:780 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32492024-11-14T06:31:58.295ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-14T06:31:58.295440351Z } propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32502024-11-14T06:31:58.295ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-14T06:31:58.295440351Z }, migration_in: None, migration_out: None }
32512024-11-14T06:31:58.308ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-14T06:31:58.308256919Z } file = sled-agent/src/instance.rs:780 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32522024-11-14T06:31:58.308ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-14T06:31:58.308256919Z } propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32532024-11-14T06:31:58.308ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32542024-11-14T06:31:58.308ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
32552024-11-14T06:31:58.308ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 15298580722506457006 n_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
32562024-11-14T06:31:58.308ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 7572478155900201653 n_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
32572024-11-14T06:31:58.308ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
32582024-11-14T06:31:58.308ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/76f3af2c-fc04-48ec-bafb-5894ba33adee/debug/bundle/zone", "/pool/int/9689d903-825b-4779-be70-9f8994af1ce1/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/3687329d-db08-4cdf-99f1-652e017f6592/crypt/debug", "/pool/ext/5c2206db-33a4-45a1-93a5-5543ab4fefe3/crypt/debug", "/pool/ext/3daa5fa9-1f5a-4fb6-b198-f46843f6caae/crypt/debug", "/pool/ext/ac1114a0-bdf6-4939-8af4-fb3fb61d8c73/crypt/debug", "/pool/ext/ad807d5e-9724-4b8a-bcac-1d8b8e2fa374/crypt/debug", "/pool/ext/4ce86c2f-d73a-421e-8735-58bc8979e498/crypt/debug", "/pool/ext/93a2b028-0235-4af9-913d-cd3caeb886d5/crypt/debug", "/pool/ext/195bff2e-21e5-469e-88de-7266b55e8b12/crypt/debug", "/pool/ext/ad99b41b-bddf-41c4-a707-9a9d5f683a3f/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c
32592024-11-14T06:31:58.951ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c", bundle_id: 243b18f1-ad34-4c0a-bebc-d8e3a80cca2d }, time_created: 2024-11-14T06:31:58.309066735Z, version: 0, cause: TerminatedInstance }
32602024-11-14T06:31:58.952ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_cfc37030-f2c9-4bb4-a779-ab660b5b818c file = sled-agent/src/instance.rs:1032 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
32612024-11-14T06:31:59.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34035
32622024-11-14T06:31:59.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53691
32632024-11-14T06:31:59.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33576
32642024-11-14T06:31:59.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33576 req_id = a4bf0c76-54e2-4d8a-a817-4230e70f764e response_code = 200 uri = /vpc-routes
32652024-11-14T06:31:59.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53940
32662024-11-14T06:31:59.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53940 req_id = 9e7ae88e-83fc-4892-9bc8-8aafc5466256 response_code = 200 uri = /vpc-routes
32672024-11-14T06:31:59.739ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {e512c863-a3a7-4159-b07b-5b9aed47edd2: {10.151.2.175: {1c5c0270-8422-4f37-a051-530b9bd30aae}, 10.151.2.176: {1c5c0270-8422-4f37-a051-530b9bd30aae}}} }
32682024-11-14T06:31:59.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53940 req_id = 75c24f46-2f40-4136-9cf8-137d0b2749c8 response_code = 204 uri = /eip-gateways
32692024-11-14T06:31:59.740ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {e512c863-a3a7-4159-b07b-5b9aed47edd2: {10.151.2.175: {1c5c0270-8422-4f37-a051-530b9bd30aae}, 10.151.2.176: {1c5c0270-8422-4f37-a051-530b9bd30aae}}} }
32702024-11-14T06:31:59.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33576 req_id = 62f43cf8-0a9a-47d7-b3e8-4457d1812302 response_code = 204 uri = /eip-gateways
32712024-11-14T06:31:59.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60544
32722024-11-14T06:31:59.741ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32732024-11-14T06:31:59.789ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32742024-11-14T06:31:59.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118563 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60544 req_id = 1982917a-e15f-4ddc-9472-be4490b01feb response_code = 204 uri = /switch-ports
32752024-11-14T06:31:59.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48543
32762024-11-14T06:31:59.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42915
32772024-11-14T06:31:59.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41467
32782024-11-14T06:31:59.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 347 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53940 req_id = 9b612757-3981-4970-859f-497522849f7c response_code = 204 uri = /vpc-routes
32792024-11-14T06:31:59.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 412 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60544 req_id = dc99f685-3931-4c06-8c1a-0c2f9b46593c response_code = 200 uri = /network-bootstore-config
32802024-11-14T06:31:59.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48543 req_id = 06c511cd-b351-4e0a-a108-e35085b57c5c response_code = 200 uri = /v2p
32812024-11-14T06:31:59.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 554 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33576 req_id = 3e068fa5-da6f-42a6-8fa0-8fcb411f20b4 response_code = 204 uri = /vpc-routes
32822024-11-14T06:31:59.861ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32832024-11-14T06:31:59.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49061
32842024-11-14T06:31:59.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49061 req_id = 349f350a-a073-46c7-a5e6-85d660e567f8 response_code = 200 uri = /v2p
32852024-11-14T06:31:59.909ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32862024-11-14T06:31:59.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62030
32872024-11-14T06:31:59.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62030 req_id = 0de9036e-aa29-43ec-a6de-56a7257469ee response_code = 200 uri = /vpc-routes
32882024-11-14T06:31:59.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113837 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42915 req_id = d0adb54b-edbc-45f2-9629-f533e777f80b response_code = 204 uri = /switch-ports
32892024-11-14T06:31:59.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42915 req_id = 26f565a9-4e2e-4def-adc5-3b1c9a4404ff response_code = 200 uri = /network-bootstore-config
32902024-11-14T06:31:59.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55155
32912024-11-14T06:31:59.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55155 req_id = 38b21ad9-db2a-4664-9a4c-134c57cff271 response_code = 200 uri = /v2p
32922024-11-14T06:32:00.005ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {e512c863-a3a7-4159-b07b-5b9aed47edd2: {10.151.2.175: {1c5c0270-8422-4f37-a051-530b9bd30aae}, 10.151.2.176: {1c5c0270-8422-4f37-a051-530b9bd30aae}}} }
32932024-11-14T06:32:00.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62030 req_id = 1553e64e-fac4-4097-8416-52feb31627ee response_code = 204 uri = /eip-gateways
32942024-11-14T06:32:00.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62030 req_id = da774dfe-ba5c-4706-846f-d77f0031f4db response_code = 204 uri = /vpc-routes
32952024-11-14T06:32:00.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55787
32962024-11-14T06:32:00.089ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32972024-11-14T06:32:00.135ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32982024-11-14T06:32:00.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126495 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55787 req_id = a37a959a-78ac-4e28-90c2-5b7e4c446f85 response_code = 204 uri = /switch-ports
32992024-11-14T06:32:00.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55787 req_id = 7f7b6864-1c89-4c26-8a35-32bce338932a response_code = 200 uri = /network-bootstore-config
33002024-11-14T06:32:00.723ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
33012024-11-14T06:32:00.741ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(748766), kind: System }
33022024-11-14T06:32:00.741ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(748766), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
33032024-11-14T06:32:00.742ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T06:32:00.742217223Z }, migration_in: None, migration_out: None }
33042024-11-14T06:32:00.782ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T06:32:00.742217223Z }, migration_in: None, migration_out: None }
33052024-11-14T06:32:00.785ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = dc849cad-a863-4ceb-a084-716be6d12072 propolis_id = cfc37030-f2c9-4bb4-a779-ab660b5b818c
33062024-11-14T06:32:00.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1139744 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53691 req_id = 5d9300ac-a05f-4c3a-aa81-a353e80d35e5 response_code = 200 uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c/state
33072024-11-14T06:32:00.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1163050 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34035 req_id = c280449c-98eb-4215-8dcf-2154d875f983 response_code = 200 uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c/state
33082024-11-14T06:32:00.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 929778 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41467 req_id = fce2c818-4945-4e1f-8acf-8e108e5e82ff response_code = 200 uri = /vmms/cfc37030-f2c9-4bb4-a779-ab660b5b818c/state
33092024-11-14T06:32:01.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38561
33102024-11-14T06:32:01.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38561 req_id = 5cbcf5f4-741f-456b-8ba7-e6f44ca6b9b2 response_code = 200 uri = /vpc-routes
33112024-11-14T06:32:01.383ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
33122024-11-14T06:32:01.383ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
33132024-11-14T06:32:01.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38561 req_id = ff25f4b5-ed96-4eb9-b9ac-cd99e51c5faa response_code = 204 uri = /eip-gateways
33142024-11-14T06:32:01.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38561 req_id = 617b7bfa-67de-4d96-9434-0fd84f3095d8 response_code = 204 uri = /vpc-routes
33152024-11-14T06:32:01.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37813
33162024-11-14T06:32:01.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37813 req_id = 37047881-0a38-4bcc-96ec-dd2c1cae5ea7 response_code = 200 uri = /v2p
33172024-11-14T06:32:01.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65300
33182024-11-14T06:32:01.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65300 req_id = 5ece4422-19aa-4c07-8226-1944449e01dc response_code = 200 uri = /v2p
33192024-11-14T06:32:01.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63960
33202024-11-14T06:32:01.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63960 req_id = 00089a4d-7b15-4d97-b3db-6ace2c85ebdc response_code = 200 uri = /vpc-routes
33212024-11-14T06:32:01.838ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
33222024-11-14T06:32:01.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63960 req_id = a0462782-39cf-4743-a290-80e12acca325 response_code = 204 uri = /eip-gateways
33232024-11-14T06:32:01.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63960 req_id = 61090a8a-b574-4728-ba98-11c5d3b5fd06 response_code = 204 uri = /vpc-routes
33242024-11-14T06:32:02.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55641
33252024-11-14T06:32:02.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55641 req_id = 9330a3c7-cfca-47b1-ab2d-ad4034fe5893 response_code = 200 uri = /vpc-routes
33262024-11-14T06:32:02.522ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d values = ExternalIpGatewayMap { mappings: {} }
33272024-11-14T06:32:02.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55641 req_id = 1f149ef5-fe24-4a90-9aec-07a35241b370 response_code = 204 uri = /eip-gateways
33282024-11-14T06:32:02.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55641 req_id = dc4bfe61-5ec2-4404-b2ad-504d867912c4 response_code = 204 uri = /vpc-routes
33292024-11-14T06:32:04.504ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
33302024-11-14T06:32:04.505ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
33312024-11-14T06:32:04.508ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
33322024-11-14T06:32:04.509ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d