Max level shown:
1 [ Dec 12 22:30:46 Enabled. ]
2 [ Dec 12 22:30:46 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 12 22:30:46 Method "start" exited with status 0. ]
4 [ Dec 12 22:30:46 Rereading configuration. ]
5 [ Dec 12 22:30:46 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-12T22:30:46.994ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-12T22:30:46.994ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-12T22:30:47.048ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-12T22:30:47.048ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-12T22:30:47.163ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-12T22:30:47.172ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-12T22:30:47.179ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-12T22:30:47.781ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-12-12T22:30:47.923ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-12T22:30:47.924ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-12T22:30:47.924ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-12T22:30:47.924ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-12T22:30:47.924ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-12-12T22:30:47.924ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-12T22:30:47.927ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-12T22:30:47.927ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-12T22:30:47.927ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-12T22:30:47.927ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-12T22:30:47.927ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-12T22:30:47.927ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-12T22:30:47.927ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-12-12T22:30:47.927ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-12T22:30:47.927ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-12T22:30:47.939ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-12T22:30:47.939ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 5119dcd2-c20b-49c6-bcd2-5936df3c4a7b (zpool)
322024-12-12T22:30:48.044ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5119dcd2-c20b-49c6-bcd2-5936df3c4a7b (zpool), kind: Internal }
332024-12-12T22:30:48.520ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-12-12T22:30:48.520ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-12T22:30:48.520ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-12T22:30:48.520ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-12T22:30:48.520ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-12-12T22:30:48.520ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-12T22:30:48.520ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-12T22:30:48.529ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-12T22:30:48.529ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = e961868f-b7f7-4714-8a9f-9bb5fb9fe86d (zpool)
422024-12-12T22:30:48.625ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e961868f-b7f7-4714-8a9f-9bb5fb9fe86d (zpool), kind: Internal }
432024-12-12T22:30:49.110ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-12T22:30:49.110ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5119dcd2-c20b-49c6-bcd2-5936df3c4a7b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e961868f-b7f7-4714-8a9f-9bb5fb9fe86d (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-12T22:30:49.110ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-12T22:30:49.110ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-12T22:30:49.110ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-12-12T22:30:49.110ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-12T22:30:49.110ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-12T22:30:49.110ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5119dcd2-c20b-49c6-bcd2-5936df3c4a7b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e961868f-b7f7-4714-8a9f-9bb5fb9fe86d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-12T22:30:49.110ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
522024-12-12T22:30:49.110ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
532024-12-12T22:30:49.110ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
542024-12-12T22:30:49.110ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-12-12T22:30:49.110ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-12T22:30:49.110ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5119dcd2-c20b-49c6-bcd2-5936df3c4a7b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e961868f-b7f7-4714-8a9f-9bb5fb9fe86d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-12-12T22:30:49.110ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
582024-12-12T22:30:49.110ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-12-12T22:30:49.110ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-12-12T22:30:49.110ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-12-12T22:30:49.110ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-12T22:30:49.110ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5119dcd2-c20b-49c6-bcd2-5936df3c4a7b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e961868f-b7f7-4714-8a9f-9bb5fb9fe86d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-12-12T22:30:49.110ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-12-12T22:30:49.110ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652024-12-12T22:30:49.110ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
662024-12-12T22:30:49.110ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-12-12T22:30:49.110ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-12T22:30:49.111ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5119dcd2-c20b-49c6-bcd2-5936df3c4a7b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e961868f-b7f7-4714-8a9f-9bb5fb9fe86d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-12T22:30:49.111ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-12-12T22:30:49.111ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-12-12T22:30:49.111ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-12-12T22:30:49.111ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-12-12T22:30:49.111ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-12T22:30:49.111ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5119dcd2-c20b-49c6-bcd2-5936df3c4a7b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e961868f-b7f7-4714-8a9f-9bb5fb9fe86d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-12T22:30:49.111ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-12T22:30:49.111ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-12T22:30:49.111ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-12-12T22:30:49.111ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-12T22:30:49.111ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-12T22:30:49.111ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5119dcd2-c20b-49c6-bcd2-5936df3c4a7b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e961868f-b7f7-4714-8a9f-9bb5fb9fe86d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-12-12T22:30:49.111ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
822024-12-12T22:30:49.111ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
832024-12-12T22:30:49.111ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
842024-12-12T22:30:49.111ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-12-12T22:30:49.111ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-12T22:30:49.111ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-12-12T22:30:49.111ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5119dcd2-c20b-49c6-bcd2-5936df3c4a7b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e961868f-b7f7-4714-8a9f-9bb5fb9fe86d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
882024-12-12T22:30:49.111ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
892024-12-12T22:30:49.111ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-12-12T22:30:49.111ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-12-12T22:30:49.111ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-12-12T22:30:49.111ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5119dcd2-c20b-49c6-bcd2-5936df3c4a7b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e961868f-b7f7-4714-8a9f-9bb5fb9fe86d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932024-12-12T22:30:49.111ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
942024-12-12T22:30:49.111ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
952024-12-12T22:30:49.111ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
962024-12-12T22:30:49.111ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972024-12-12T22:30:49.111ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-12T22:30:49.111ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5119dcd2-c20b-49c6-bcd2-5936df3c4a7b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e961868f-b7f7-4714-8a9f-9bb5fb9fe86d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
992024-12-12T22:30:49.111ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1002024-12-12T22:30:49.111ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-12-12T22:30:49.111ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-12-12T22:30:49.111ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-12-12T22:30:49.111ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-12T22:30:49.111ZINFOSledAgent (bootstore): No ledger in /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-12-12T22:30:49.111ZINFOSledAgent (bootstore): No ledger in /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-12-12T22:30:49.111ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-12-12T22:30:49.111ZINFOSledAgent (bootstore): No ledger in /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-12-12T22:30:49.111ZINFOSledAgent (bootstore): No ledger in /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-12-12T22:30:49.111ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-12-12T22:30:49.111ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-12T22:30:49.111ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-12T22:30:49.122ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-12-12T22:30:49.122ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 3779, tv_nsec: 177522772 } time_to_next_cleanup = 599.999916358s
1142024-12-12T22:30:49.122ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-12-12T22:30:49.122ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-12-12T22:30:49.122ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-12T22:30:49.125ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-12T22:30:49.126ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-12-12T22:30:49.127ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-12-12T22:30:49.128ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-12T22:30:49.128ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-12T22:30:49.128ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-12-12T22:30:49.128ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1242024-12-12T22:30:49.128ZINFOSledAgent (RSS): No ledger in /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-12T22:30:49.128ZINFOSledAgent (RSS): No ledger in /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-12T22:30:49.128ZINFOSledAgent (RSS): No ledger in /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-12T22:30:49.128ZINFOSledAgent (RSS): No ledger in /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-12T22:30:49.128ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-12T22:30:49.128ZINFOSledAgent (RSS): Writing ledger to /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-12T22:30:49.128ZINFOSledAgent (RSS): Writing ledger to /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-12T22:30:49.128ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-12T22:30:49.128ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-12T22:30:49.128ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-12T22:30:49.128ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-12T22:30:49.129ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362024-12-12T22:30:49.129ZINFOSledAgent (bootstore): Writing ledger to /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372024-12-12T22:30:49.129ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382024-12-12T22:30:49.129ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392024-12-12T22:30:49.129ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 4a8c9490-d35a-4221-8585-e4103b325118 (sled), rack_id: ceaea472-35b2-490f-a91b-ab350691945c, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402024-12-12T22:30:49.130ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1412024-12-12T22:30:49.130ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1422024-12-12T22:30:49.134ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-12T22:30:49.139ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-12T22:30:49.139ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-12T22:30:49.144ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-12T22:30:49.144ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-12T22:30:49.144ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:54210
1482024-12-12T22:30:49.144ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 4a8c9490-d35a-4221-8585-e4103b325118 (sled), rack_id: ceaea472-35b2-490f-a91b-ab350691945c, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-12T22:30:49.144ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-12T22:30:49.145ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-12T22:30:49.145ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522024-12-12T22:30:49.145ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1532024-12-12T22:30:49.145ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1542024-12-12T22:30:49.145ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552024-12-12T22:30:49.145ZINFOSledAgent (StorageManager): No ledger in /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562024-12-12T22:30:49.145ZINFOSledAgent (StorageManager): No ledger in /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-12T22:30:49.145ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1582024-12-12T22:30:49.145ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1592024-12-12T22:30:49.145ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1602024-12-12T22:30:49.145ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-12T22:30:49.145ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1622024-12-12T22:30:49.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1632024-12-12T22:30:49.183ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-12T22:30:49.201ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-12T22:30:49.209ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:415 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
1662024-12-12T22:30:49.209ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1672024-12-12T22:30:49.209ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:427 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
1682024-12-12T22:30:49.209ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692024-12-12T22:30:49.212ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 60.514806ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8d9b7643-1bc3-4297-8af9-4d1c7c8fddd1", "content-length": "124", "date": "Thu, 12 Dec 2024 22:30:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8d9b7643-1bc3-4297-8af9-4d1c7c8fddd1" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-12T22:30:49.222ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-12T22:30:49.245ZINFOSledAgent: successfully created encrypted zvol: name="oxi_5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-12T22:30:49.245ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-12T22:30:49.250ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:442 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
1742024-12-12T22:30:49.250ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1752024-12-12T22:30:49.250ZINFOSledAgent (BackingFs): Ensuring dataset oxi_5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/backing/fmd file = sled-agent/src/backing_fs.rs:138
1762024-12-12T22:30:49.273ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-12-12T22:30:49.274ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 147.835353ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "860a5175-0489-4a4b-917c-9e957aeb53b7", "content-length": "124", "date": "Thu, 12 Dec 2024 22:30:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "860a5175-0489-4a4b-917c-9e957aeb53b7" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-12-12T22:30:49.337ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1792024-12-12T22:30:49.422ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-12T22:30:49.423ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 109.918643ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "76ab7f23-71cd-4942-afa7-941eaa693fc9", "content-length": "124", "date": "Thu, 12 Dec 2024 22:30:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "76ab7f23-71cd-4942-afa7-941eaa693fc9" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-12T22:30:49.533ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-12-12T22:30:49.533ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 244.484536ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d1f0abf5-4d8f-4839-8a4b-2eeded71e16e", "content-length": "124", "date": "Thu, 12 Dec 2024 22:30:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d1f0abf5-4d8f-4839-8a4b-2eeded71e16e" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-12-12T22:30:49.555ZINFOSledAgent (BackingFs): Mounting oxi_5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1842024-12-12T22:30:49.567ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1852024-12-12T22:30:49.568ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1862024-12-12T22:30:49.568ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1872024-12-12T22:30:49.568ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1882024-12-12T22:30:49.780ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-12T22:30:49.781ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 232.588836ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4dbf5d28-cfe8-44f0-87a1-8fb94447bbc8", "content-length": "124", "date": "Thu, 12 Dec 2024 22:30:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4dbf5d28-cfe8-44f0-87a1-8fb94447bbc8" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-12T22:30:50.014ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-12T22:30:50.015ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 329.995155ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7f7ea7c9-9e55-4e6d-88a3-d8ed843a1613", "content-length": "124", "date": "Thu, 12 Dec 2024 22:30:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7f7ea7c9-9e55-4e6d-88a3-d8ed843a1613" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-12T22:30:50.302ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
1932024-12-12T22:30:50.308ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:56260 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
1942024-12-12T22:30:50.308ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
1952024-12-12T22:30:50.308ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:56260 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 4a8c9490-d35a-4221-8585-e4103b325118 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
1962024-12-12T22:30:50.309ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 362.322121ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
1972024-12-12T22:30:50.310ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
1982024-12-12T22:30:50.310ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
1992024-12-12T22:30:50.310ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2002024-12-12T22:30:50.310ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2012024-12-12T22:30:50.346ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2022024-12-12T22:30:50.673ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 349.744816ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
2032024-12-12T22:30:51.024ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.392388534s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
2042024-12-12T22:30:52.418ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.235598129s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
2052024-12-12T22:30:52.831ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2062024-12-12T22:30:52.831ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2072024-12-12T22:30:52.831ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2082024-12-12T22:30:52.831ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2092024-12-12T22:30:52.831ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2102024-12-12T22:30:52.831ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2112024-12-12T22:30:52.833ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2122024-12-12T22:30:52.835ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2132024-12-12T22:30:52.835ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='bb9dca28-dea1-4105-b015-9af4a5ccce7e'/> <propval type="astring" name="rack_id" value='ceaea472-35b2-490f-a91b-ab350691945c'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe84:c2d9'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='ceaea472-35b2-490f-a91b-ab350691945c'/> <propval type="astring" name="sled_id" value='4a8c9490-d35a-4221-8585-e4103b325118'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='4a8c9490-d35a-4221-8585-e4103b325118'/> <propval type="astring" name="rack_uuid" value='ceaea472-35b2-490f-a91b-ab350691945c'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='4a8c9490-d35a-4221-8585-e4103b325118'/> <propval type="astring" name="rack_uuid" value='ceaea472-35b2-490f-a91b-ab350691945c'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142024-12-12T22:30:52.835ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152024-12-12T22:30:53.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 57.258852ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162024-12-12T22:30:53.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 57.416919ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172024-12-12T22:30:53.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 154.192427ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-12T22:30:53.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 299.47088ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-12T22:30:53.656ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.509249507s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
2202024-12-12T22:30:54.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 552.310189ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-12T22:30:54.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.499012606s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-12T22:30:56.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.360163041s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-12T22:30:57.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 787.209191ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-12T22:30:58.167ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.759515615s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
2252024-12-12T22:30:59.028ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/4a8c9490-d35a-4221-8585-e4103b325118) file = sled-agent/src/nexus.rs:527 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
2262024-12-12T22:30:59.058ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2272024-12-12T22:30:59.059ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
2282024-12-12T22:30:59.067ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2292024-12-12T22:30:59.067ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2302024-12-12T22:30:59.067ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2312024-12-12T22:30:59.067ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322024-12-12T22:30:59.068ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332024-12-12T22:30:59.068ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2342024-12-12T22:30:59.068ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2352024-12-12T22:30:59.068ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2362024-12-12T22:30:59.068ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:54210
2372024-12-12T22:30:59.291ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2382024-12-12T22:30:59.291ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2392024-12-12T22:30:59.296ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2402024-12-12T22:30:59.296ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2412024-12-12T22:30:59.297ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2422024-12-12T22:30:59.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55112
2432024-12-12T22:30:59.556ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2442024-12-12T22:30:59.556ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2452024-12-12T22:30:59.556ZINFOSledAgent (ServiceManager): No ledger in /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/omicron-zones.json file = common/src/ledger.rs:188
2462024-12-12T22:30:59.556ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/omicron-zones.json file = common/src/ledger.rs:188
2472024-12-12T22:30:59.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 375 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55112 req_id = d3822a7b-7784-4876-9d26-0eeae0a7057b response_code = 200 uri = /inventory
2482024-12-12T22:30:59.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60773
2492024-12-12T22:30:59.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60773 req_id = ddb6650f-a479-4af8-bfb8-a58ec1748e59 response_code = 200 uri = /sled-role
2502024-12-12T22:30:59.619ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: f44b2a4b-13a1-45a1-a4b6-62b638300768 (physical_disk), pool_id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 43fe7431-9be0-4b0a-92a3-defd7a65d29a (physical_disk), pool_id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: dd59a4cd-91af-4947-98c0-aeccbe77e648 (physical_disk), pool_id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: f39e81a4-26e2-4226-865f-7e76631cdb5d (physical_disk), pool_id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 82f10c8f-d962-4ca1-973d-e35f38a002a7 (physical_disk), pool_id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 7b00a1b5-80c5-42f3-8f94-bb13b3fa8625 (physical_disk), pool_id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 3df77c9d-a509-4db6-961c-c78ffe40f6cf (physical_disk), pool_id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: b10b8eec-2683-4122-ba78-d2269cb86ec7 (physical_disk), pool_id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: aebf9e4b-9c07-4533-9528-f713d49adea5 (physical_disk), pool_id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2512024-12-12T22:30:59.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50667
2522024-12-12T22:30:59.619ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
2532024-12-12T22:30:59.619ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: f44b2a4b-13a1-45a1-a4b6-62b638300768 (physical_disk), pool_id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 43fe7431-9be0-4b0a-92a3-defd7a65d29a (physical_disk), pool_id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: dd59a4cd-91af-4947-98c0-aeccbe77e648 (physical_disk), pool_id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: f39e81a4-26e2-4226-865f-7e76631cdb5d (physical_disk), pool_id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 82f10c8f-d962-4ca1-973d-e35f38a002a7 (physical_disk), pool_id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 7b00a1b5-80c5-42f3-8f94-bb13b3fa8625 (physical_disk), pool_id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 3df77c9d-a509-4db6-961c-c78ffe40f6cf (physical_disk), pool_id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: b10b8eec-2683-4122-ba78-d2269cb86ec7 (physical_disk), pool_id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: aebf9e4b-9c07-4533-9528-f713d49adea5 (physical_disk), pool_id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2542024-12-12T22:30:59.619ZINFOSledAgent (StorageManager): No ledger in /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2552024-12-12T22:30:59.619ZINFOSledAgent (StorageManager): No ledger in /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562024-12-12T22:30:59.619ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2572024-12-12T22:30:59.619ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2582024-12-12T22:30:59.619ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2592024-12-12T22:30:59.620ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2602024-12-12T22:30:59.620ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2612024-12-12T22:30:59.756ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2622024-12-12T22:30:59.756ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool)
2632024-12-12T22:31:00.228ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
2642024-12-12T22:31:00.230ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/4a8c9490-d35a-4221-8585-e4103b325118) file = sled-agent/src/probe_manager.rs:231 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
2652024-12-12T22:31:00.291ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }
2662024-12-12T22:31:00.299ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2672024-12-12T22:31:00.299ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2682024-12-12T22:31:00.299ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2692024-12-12T22:31:00.299ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2702024-12-12T22:31:00.299ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2712024-12-12T22:31:00.300ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2722024-12-12T22:31:00.300ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2732024-12-12T22:31:00.312ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11945109518193762894 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
2742024-12-12T22:31:00.313ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6364488794010925785 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
2752024-12-12T22:31:00.336ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2762024-12-12T22:31:00.344ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/zone file = sled-storage/src/dataset.rs:303
2772024-12-12T22:31:00.518ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 file = sled-storage/src/dataset.rs:389
2782024-12-12T22:31:00.526ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2792024-12-12T22:31:00.526ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2802024-12-12T22:31:00.526ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2812024-12-12T22:31:00.526ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2822024-12-12T22:31:00.526ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2832024-12-12T22:31:00.536ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2842024-12-12T22:31:00.536ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool)
2852024-12-12T22:31:00.631ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }
2862024-12-12T22:31:00.639ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
2872024-12-12T22:31:00.639ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
2882024-12-12T22:31:00.639ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
2892024-12-12T22:31:00.639ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
2902024-12-12T22:31:00.639ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912024-12-12T22:31:00.639ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922024-12-12T22:31:00.639ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2932024-12-12T22:31:00.675ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2942024-12-12T22:31:00.682ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/zone file = sled-storage/src/dataset.rs:303
2952024-12-12T22:31:00.853ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908 file = sled-storage/src/dataset.rs:389
2962024-12-12T22:31:00.861ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2972024-12-12T22:31:00.861ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2982024-12-12T22:31:00.861ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2992024-12-12T22:31:00.861ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3002024-12-12T22:31:00.861ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3012024-12-12T22:31:00.870ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3022024-12-12T22:31:00.870ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool)
3032024-12-12T22:31:00.963ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }
3042024-12-12T22:31:00.971ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3052024-12-12T22:31:00.971ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3062024-12-12T22:31:00.971ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3072024-12-12T22:31:00.971ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3082024-12-12T22:31:00.971ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092024-12-12T22:31:00.971ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102024-12-12T22:31:00.971ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3112024-12-12T22:31:01.005ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3122024-12-12T22:31:01.013ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_662d717a-a0c0-4538-854a-f7813f739fb9/crypt/zone file = sled-storage/src/dataset.rs:303
3132024-12-12T22:31:01.188ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_662d717a-a0c0-4538-854a-f7813f739fb9 file = sled-storage/src/dataset.rs:389
3142024-12-12T22:31:01.197ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3152024-12-12T22:31:01.197ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3162024-12-12T22:31:01.197ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3172024-12-12T22:31:01.197ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3182024-12-12T22:31:01.197ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3192024-12-12T22:31:01.207ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3202024-12-12T22:31:01.207ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool)
3212024-12-12T22:31:01.302ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }
3222024-12-12T22:31:01.309ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3232024-12-12T22:31:01.310ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3242024-12-12T22:31:01.310ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3252024-12-12T22:31:01.310ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3262024-12-12T22:31:01.310ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3272024-12-12T22:31:01.310ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282024-12-12T22:31:01.310ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3292024-12-12T22:31:01.313ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/4a8c9490-d35a-4221-8585-e4103b325118) file = sled-agent/src/probe_manager.rs:231 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
3302024-12-12T22:31:01.345ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3312024-12-12T22:31:01.353ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_06e7bad6-773d-4089-9ade-6e4f457beccc/crypt/zone file = sled-storage/src/dataset.rs:303
3322024-12-12T22:31:01.523ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_06e7bad6-773d-4089-9ade-6e4f457beccc file = sled-storage/src/dataset.rs:389
3332024-12-12T22:31:01.530ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3342024-12-12T22:31:01.530ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3352024-12-12T22:31:01.531ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3362024-12-12T22:31:01.531ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3372024-12-12T22:31:01.531ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3382024-12-12T22:31:01.541ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3392024-12-12T22:31:01.541ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool)
3402024-12-12T22:31:01.640ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }
3412024-12-12T22:31:01.648ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3422024-12-12T22:31:01.648ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3432024-12-12T22:31:01.648ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3442024-12-12T22:31:01.648ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3452024-12-12T22:31:01.648ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462024-12-12T22:31:01.648ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-12-12T22:31:01.648ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3482024-12-12T22:31:01.683ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3492024-12-12T22:31:01.691ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5/crypt/zone file = sled-storage/src/dataset.rs:303
3502024-12-12T22:31:01.863ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5 file = sled-storage/src/dataset.rs:389
3512024-12-12T22:31:01.871ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3522024-12-12T22:31:01.871ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3532024-12-12T22:31:01.871ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3542024-12-12T22:31:01.871ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3552024-12-12T22:31:01.871ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3562024-12-12T22:31:01.881ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3572024-12-12T22:31:01.881ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3c596d62-0729-49f7-ab54-437e3babc937 (zpool)
3582024-12-12T22:31:01.974ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }
3592024-12-12T22:31:01.983ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3602024-12-12T22:31:01.983ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3612024-12-12T22:31:01.983ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3622024-12-12T22:31:01.983ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3632024-12-12T22:31:01.983ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642024-12-12T22:31:01.983ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-12-12T22:31:01.983ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3662024-12-12T22:31:02.019ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3672024-12-12T22:31:02.028ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3c596d62-0729-49f7-ab54-437e3babc937/crypt/zone file = sled-storage/src/dataset.rs:303
3682024-12-12T22:31:02.204ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3c596d62-0729-49f7-ab54-437e3babc937 file = sled-storage/src/dataset.rs:389
3692024-12-12T22:31:02.212ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3702024-12-12T22:31:02.212ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3712024-12-12T22:31:02.212ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3722024-12-12T22:31:02.212ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3732024-12-12T22:31:02.212ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3742024-12-12T22:31:02.222ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3752024-12-12T22:31:02.222ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool)
3762024-12-12T22:31:02.320ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }
3772024-12-12T22:31:02.327ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3782024-12-12T22:31:02.327ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3792024-12-12T22:31:02.327ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3802024-12-12T22:31:02.327ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3812024-12-12T22:31:02.328ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3822024-12-12T22:31:02.328ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832024-12-12T22:31:02.328ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3842024-12-12T22:31:02.363ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3852024-12-12T22:31:02.368ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/4a8c9490-d35a-4221-8585-e4103b325118) file = sled-agent/src/probe_manager.rs:231 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
3862024-12-12T22:31:02.373ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ffe707ac-7f49-497d-beef-33098ae2bcc4/crypt/zone file = sled-storage/src/dataset.rs:303
3872024-12-12T22:31:02.548ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ffe707ac-7f49-497d-beef-33098ae2bcc4 file = sled-storage/src/dataset.rs:389
3882024-12-12T22:31:02.556ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3892024-12-12T22:31:02.556ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3902024-12-12T22:31:02.556ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3912024-12-12T22:31:02.556ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3922024-12-12T22:31:02.556ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3932024-12-12T22:31:02.566ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3942024-12-12T22:31:02.566ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool)
3952024-12-12T22:31:02.665ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }
3962024-12-12T22:31:02.672ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
3972024-12-12T22:31:02.672ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
3982024-12-12T22:31:02.672ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
3992024-12-12T22:31:02.672ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4002024-12-12T22:31:02.672ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012024-12-12T22:31:02.672ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022024-12-12T22:31:02.672ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4032024-12-12T22:31:02.708ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4042024-12-12T22:31:02.716ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0101354b-4aed-4a3c-aa42-78e2e2510c9b/crypt/zone file = sled-storage/src/dataset.rs:303
4052024-12-12T22:31:02.898ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0101354b-4aed-4a3c-aa42-78e2e2510c9b file = sled-storage/src/dataset.rs:389
4062024-12-12T22:31:02.906ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4072024-12-12T22:31:02.906ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4082024-12-12T22:31:02.906ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4092024-12-12T22:31:02.906ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4102024-12-12T22:31:02.906ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4112024-12-12T22:31:02.916ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4122024-12-12T22:31:02.916ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool)
4132024-12-12T22:31:03.033ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }
4142024-12-12T22:31:03.041ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4152024-12-12T22:31:03.041ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4162024-12-12T22:31:03.041ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4172024-12-12T22:31:03.041ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4182024-12-12T22:31:03.041ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4192024-12-12T22:31:03.042ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202024-12-12T22:31:03.042ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4212024-12-12T22:31:03.082ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4222024-12-12T22:31:03.090ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8ec50946-b029-4583-84f3-35d2ce5b9dff/crypt/zone file = sled-storage/src/dataset.rs:303
4232024-12-12T22:31:03.267ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8ec50946-b029-4583-84f3-35d2ce5b9dff file = sled-storage/src/dataset.rs:389
4242024-12-12T22:31:03.276ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4252024-12-12T22:31:03.276ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4262024-12-12T22:31:03.276ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4272024-12-12T22:31:03.276ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5119dcd2-c20b-49c6-bcd2-5936df3c4a7b (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e961868f-b7f7-4714-8a9f-9bb5fb9fe86d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4282024-12-12T22:31:03.276ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4292024-12-12T22:31:03.276ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4302024-12-12T22:31:03.276ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312024-12-12T22:31:03.276ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
4322024-12-12T22:31:03.276ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4332024-12-12T22:31:03.276ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(2) sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
4342024-12-12T22:31:03.276ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
4352024-12-12T22:31:03.276ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
4362024-12-12T22:31:03.276ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
4372024-12-12T22:31:03.276ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
4382024-12-12T22:31:03.276ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4392024-12-12T22:31:03.276ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
4402024-12-12T22:31:03.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3657224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50667 req_id = 8b83881d-66f0-41cf-85a0-1efb52ae7a93 response_code = 200 uri = /omicron-physical-disks
4412024-12-12T22:31:03.308ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0018f959-917f-4de6-97bb-5b11c5366852 (dataset): DatasetConfig { id: 0018f959-917f-4de6-97bb-5b11c5366852 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 014f483f-c37d-4512-8c21-1fa4049a63d2 (dataset): DatasetConfig { id: 014f483f-c37d-4512-8c21-1fa4049a63d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 029723b4-9475-4404-a45b-3793793bbc0c (dataset): DatasetConfig { id: 029723b4-9475-4404-a45b-3793793bbc0c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02e51bf5-baf1-4570-8ca8-f282035c58ea (dataset): DatasetConfig { id: 02e51bf5-baf1-4570-8ca8-f282035c58ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0478fe97-62f1-4999-bda3-7591a57ad7e7 (dataset): DatasetConfig { id: 0478fe97-62f1-4999-bda3-7591a57ad7e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08ab9818-d4c1-410e-80b2-0c862e288f9f (dataset): DatasetConfig { id: 08ab9818-d4c1-410e-80b2-0c862e288f9f (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c5b666c-fbae-4b71-af73-6357a6ae929e (dataset): DatasetConfig { id: 0c5b666c-fbae-4b71-af73-6357a6ae929e (dataset), name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c71f7a1-6e74-4ee6-aa7a-4172dfac7387 (dataset): DatasetConfig { id: 0c71f7a1-6e74-4ee6-aa7a-4172dfac7387 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0dd2aab6-29e0-4968-afe5-85e6e0a477f5 (dataset): DatasetConfig { id: 0dd2aab6-29e0-4968-afe5-85e6e0a477f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18e23126-8797-4b36-b0a8-55bea6002cda (dataset): DatasetConfig { id: 18e23126-8797-4b36-b0a8-55bea6002cda (dataset), name: DatasetName { pool_name: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b8052a4-b7b7-4332-b0c6-894d92c30326 (dataset): DatasetConfig { id: 1b8052a4-b7b7-4332-b0c6-894d92c30326 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1d0e70ba-29fe-4886-8688-7c025b975cf9 (dataset): DatasetConfig { id: 1d0e70ba-29fe-4886-8688-7c025b975cf9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e5428ca-0289-4ab8-bd28-290f74ceed04 (dataset): DatasetConfig { id: 1e5428ca-0289-4ab8-bd28-290f74ceed04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e830dfe-65e5-4654-bc42-c079333ed297 (dataset): DatasetConfig { id: 1e830dfe-65e5-4654-bc42-c079333ed297 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20c8f1e0-45c3-45b1-b3c2-b312603290b2 (dataset): DatasetConfig { id: 20c8f1e0-45c3-45b1-b3c2-b312603290b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 229d27f2-dff2-4a89-87af-6d640a83383b (dataset): DatasetConfig { id: 229d27f2-dff2-4a89-87af-6d640a83383b (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 229e076d-be37-4c65-bbf9-5f4498c8b272 (dataset): DatasetConfig { id: 229e076d-be37-4c65-bbf9-5f4498c8b272 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24dd7265-aaa5-4a3b-9d8c-01c887b83e59 (dataset): DatasetConfig { id: 24dd7265-aaa5-4a3b-9d8c-01c887b83e59 (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25450b12-bd42-4b0d-9e96-d4c6d7f0bdb1 (dataset): DatasetConfig { id: 25450b12-bd42-4b0d-9e96-d4c6d7f0bdb1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d2b252f-c54a-4319-bfcc-a4832513310d (dataset): DatasetConfig { id: 2d2b252f-c54a-4319-bfcc-a4832513310d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e125003-e504-4c9f-80b7-736ed85b5432 (dataset): DatasetConfig { id: 2e125003-e504-4c9f-80b7-736ed85b5432 (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 335922ad-dca7-477f-aaa2-ddf995cfb232 (dataset): DatasetConfig { id: 335922ad-dca7-477f-aaa2-ddf995cfb232 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_ef370558-79d6-4859-a992-05984241db89" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 363570ed-b863-44c8-b616-184ae1d6270c (dataset): DatasetConfig { id: 363570ed-b863-44c8-b616-184ae1d6270c (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36c0c579-07c8-46a9-90f5-5f8306fd000c (dataset): DatasetConfig { id: 36c0c579-07c8-46a9-90f5-5f8306fd000c (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38f6ebc6-150c-4ff9-8a1b-405ec420d1ec (dataset): DatasetConfig { id: 38f6ebc6-150c-4ff9-8a1b-405ec420d1ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a6e796d-d46c-4306-ab9b-1e464c6d7d42 (dataset): DatasetConfig { id: 3a6e796d-d46c-4306-ab9b-1e464c6d7d42 (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3abed93e-61d3-40b8-9375-7e002e743233 (dataset): DatasetConfig { id: 3abed93e-61d3-40b8-9375-7e002e743233 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ccfb568-3395-462f-800a-1526cd106cd4 (dataset): DatasetConfig { id: 3ccfb568-3395-462f-800a-1526cd106cd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 467d34b2-3acc-4a43-9627-11f0f8633902 (dataset): DatasetConfig { id: 467d34b2-3acc-4a43-9627-11f0f8633902 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a00d649-feaa-4a60-9a58-5e1ab81a9bec (dataset): DatasetConfig { id: 4a00d649-feaa-4a60-9a58-5e1ab81a9bec (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4bb5df73-4eef-4eca-a2b9-6e88d7415d57 (dataset): DatasetConfig { id: 4bb5df73-4eef-4eca-a2b9-6e88d7415d57 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4d97d01a-b541-469f-87ae-06ded72b9747 (dataset): DatasetConfig { id: 4d97d01a-b541-469f-87ae-06ded72b9747 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 52d3b321-7fec-4d3b-bf68-0d6d2ce5d09c (dataset): DatasetConfig { id: 52d3b321-7fec-4d3b-bf68-0d6d2ce5d09c (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54058a96-03a4-40b8-863e-1966e963e04d (dataset): DatasetConfig { id: 54058a96-03a4-40b8-863e-1966e963e04d (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54d04c40-82f0-42ec-921b-45a69acf9830 (dataset): DatasetConfig { id: 54d04c40-82f0-42ec-921b-45a69acf9830 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56e44cbf-55e0-45ce-8660-a720459ed416 (dataset): DatasetConfig { id: 56e44cbf-55e0-45ce-8660-a720459ed416 (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57cdd183-f3ed-405e-8cf1-8beb66bebade (dataset): DatasetConfig { id: 57cdd183-f3ed-405e-8cf1-8beb66bebade (dataset), name: DatasetName { pool_name: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f4a2c50-8404-4b28-ac4a-a7f0bd0dc147 (dataset): DatasetConfig { id: 5f4a2c50-8404-4b28-ac4a-a7f0bd0dc147 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68ff2607-2cd9-4c22-9e41-83227ece901d (dataset): DatasetConfig { id: 68ff2607-2cd9-4c22-9e41-83227ece901d (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e89c737-e228-4e7b-a18c-34d40cf94c2a (dataset): DatasetConfig { id: 6e89c737-e228-4e7b-a18c-34d40cf94c2a (dataset), name: DatasetName { pool_name: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7145ae5e-1767-4bec-bf3b-2ec5f4277f6e (dataset): DatasetConfig { id: 7145ae5e-1767-4bec-bf3b-2ec5f4277f6e (dataset), name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 75fa9a30-d61d-4142-9b4c-c64833a76bb5 (dataset): DatasetConfig { id: 75fa9a30-d61d-4142-9b4c-c64833a76bb5 (dataset), name: DatasetName { pool_name: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 77d45e9d-bfa8-45fb-a9c1-5580b9ef61dd (dataset): DatasetConfig { id: 77d45e9d-bfa8-45fb-a9c1-5580b9ef61dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bdec283-9435-4924-bedd-9870e784d964 (dataset): DatasetConfig { id: 7bdec283-9435-4924-bedd-9870e784d964 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c109b72-0d91-4e3f-90b0-a8b8d841ad5c (dataset): DatasetConfig { id: 7c109b72-0d91-4e3f-90b0-a8b8d841ad5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80c06596-29e5-4500-ac99-8fed867e16f2 (dataset): DatasetConfig { id: 80c06596-29e5-4500-ac99-8fed867e16f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 81874b9a-e81e-4d10-abe5-1a3c62fd6a1c (dataset): DatasetConfig { id: 81874b9a-e81e-4d10-abe5-1a3c62fd6a1c (dataset), name: DatasetName { pool_name: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 842f935d-19d2-47a2-a7c1-022a2c876158 (dataset): DatasetConfig { id: 842f935d-19d2-47a2-a7c1-022a2c876158 (dataset), name: DatasetName { pool_name: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8511980e-a6aa-4bca-96bd-6b7117455d1d (dataset): DatasetConfig { id: 8511980e-a6aa-4bca-96bd-6b7117455d1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86332165-5154-41ec-af7c-16f3f176af42 (dataset): DatasetConfig { id: 86332165-5154-41ec-af7c-16f3f176af42 (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8eada516-5a05-4cda-8ee4-8ad94c7d0f71 (dataset): DatasetConfig { id: 8eada516-5a05-4cda-8ee4-8ad94c7d0f71 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7abd1c1-e727-4792-bd50-d64798a999da (dataset): DatasetConfig { id: a7abd1c1-e727-4792-bd50-d64798a999da (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a99a4962-65f9-40fc-97b3-1a1a79a71262 (dataset): DatasetConfig { id: a99a4962-65f9-40fc-97b3-1a1a79a71262 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac4a8daf-409b-4a1f-8d71-95b7b50778a3 (dataset): DatasetConfig { id: ac4a8daf-409b-4a1f-8d71-95b7b50778a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b082ab8a-74bd-43f9-bf02-a825f8d06a6e (dataset): DatasetConfig { id: b082ab8a-74bd-43f9-bf02-a825f8d06a6e (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b93f21ab-dd2f-46b3-8c94-76545ce8f8ca (dataset): DatasetConfig { id: b93f21ab-dd2f-46b3-8c94-76545ce8f8ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c752116a-9606-45a4-954a-37bf437b90be (dataset): DatasetConfig { id: c752116a-9606-45a4-954a-37bf437b90be (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c8a55a46-5bdb-4867-852a-8ed1af392f97 (dataset): DatasetConfig { id: c8a55a46-5bdb-4867-852a-8ed1af392f97 (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5c83715-fa12-468a-a41a-f3d74a37a5c8 (dataset): DatasetConfig { id: d5c83715-fa12-468a-a41a-f3d74a37a5c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d6f30621-43b5-4926-a888-5c2ed312326d (dataset): DatasetConfig { id: d6f30621-43b5-4926-a888-5c2ed312326d (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e72241cf-c57a-4f87-ab8f-e0dc7a336602 (dataset): DatasetConfig { id: e72241cf-c57a-4f87-ab8f-e0dc7a336602 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ebeeb215-2f8e-4172-901e-fd9b04c74b05 (dataset): DatasetConfig { id: ebeeb215-2f8e-4172-901e-fd9b04c74b05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eed519a4-60f5-4abc-94c1-15bc5d38925c (dataset): DatasetConfig { id: eed519a4-60f5-4abc-94c1-15bc5d38925c (dataset), name: DatasetName { pool_name: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1cf0e1e-5891-4d75-ab61-3f64b9434844 (dataset): DatasetConfig { id: f1cf0e1e-5891-4d75-ab61-3f64b9434844 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3306b96-43f2-4c84-b847-1d4a6d2e4b56 (dataset): DatasetConfig { id: f3306b96-43f2-4c84-b847-1d4a6d2e4b56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f76cf4f8-71de-46f5-82f3-c1d7e29a33f6 (dataset): DatasetConfig { id: f76cf4f8-71de-46f5-82f3-c1d7e29a33f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4422024-12-12T22:31:03.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56904
4432024-12-12T22:31:03.309ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
4442024-12-12T22:31:03.309ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0018f959-917f-4de6-97bb-5b11c5366852 (dataset): DatasetConfig { id: 0018f959-917f-4de6-97bb-5b11c5366852 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 014f483f-c37d-4512-8c21-1fa4049a63d2 (dataset): DatasetConfig { id: 014f483f-c37d-4512-8c21-1fa4049a63d2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 029723b4-9475-4404-a45b-3793793bbc0c (dataset): DatasetConfig { id: 029723b4-9475-4404-a45b-3793793bbc0c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02e51bf5-baf1-4570-8ca8-f282035c58ea (dataset): DatasetConfig { id: 02e51bf5-baf1-4570-8ca8-f282035c58ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0478fe97-62f1-4999-bda3-7591a57ad7e7 (dataset): DatasetConfig { id: 0478fe97-62f1-4999-bda3-7591a57ad7e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08ab9818-d4c1-410e-80b2-0c862e288f9f (dataset): DatasetConfig { id: 08ab9818-d4c1-410e-80b2-0c862e288f9f (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c5b666c-fbae-4b71-af73-6357a6ae929e (dataset): DatasetConfig { id: 0c5b666c-fbae-4b71-af73-6357a6ae929e (dataset), name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c71f7a1-6e74-4ee6-aa7a-4172dfac7387 (dataset): DatasetConfig { id: 0c71f7a1-6e74-4ee6-aa7a-4172dfac7387 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0dd2aab6-29e0-4968-afe5-85e6e0a477f5 (dataset): DatasetConfig { id: 0dd2aab6-29e0-4968-afe5-85e6e0a477f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18e23126-8797-4b36-b0a8-55bea6002cda (dataset): DatasetConfig { id: 18e23126-8797-4b36-b0a8-55bea6002cda (dataset), name: DatasetName { pool_name: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b8052a4-b7b7-4332-b0c6-894d92c30326 (dataset): DatasetConfig { id: 1b8052a4-b7b7-4332-b0c6-894d92c30326 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1d0e70ba-29fe-4886-8688-7c025b975cf9 (dataset): DatasetConfig { id: 1d0e70ba-29fe-4886-8688-7c025b975cf9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e5428ca-0289-4ab8-bd28-290f74ceed04 (dataset): DatasetConfig { id: 1e5428ca-0289-4ab8-bd28-290f74ceed04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e830dfe-65e5-4654-bc42-c079333ed297 (dataset): DatasetConfig { id: 1e830dfe-65e5-4654-bc42-c079333ed297 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20c8f1e0-45c3-45b1-b3c2-b312603290b2 (dataset): DatasetConfig { id: 20c8f1e0-45c3-45b1-b3c2-b312603290b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 229d27f2-dff2-4a89-87af-6d640a83383b (dataset): DatasetConfig { id: 229d27f2-dff2-4a89-87af-6d640a83383b (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 229e076d-be37-4c65-bbf9-5f4498c8b272 (dataset): DatasetConfig { id: 229e076d-be37-4c65-bbf9-5f4498c8b272 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24dd7265-aaa5-4a3b-9d8c-01c887b83e59 (dataset): DatasetConfig { id: 24dd7265-aaa5-4a3b-9d8c-01c887b83e59 (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25450b12-bd42-4b0d-9e96-d4c6d7f0bdb1 (dataset): DatasetConfig { id: 25450b12-bd42-4b0d-9e96-d4c6d7f0bdb1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d2b252f-c54a-4319-bfcc-a4832513310d (dataset): DatasetConfig { id: 2d2b252f-c54a-4319-bfcc-a4832513310d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e125003-e504-4c9f-80b7-736ed85b5432 (dataset): DatasetConfig { id: 2e125003-e504-4c9f-80b7-736ed85b5432 (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 335922ad-dca7-477f-aaa2-ddf995cfb232 (dataset): DatasetConfig { id: 335922ad-dca7-477f-aaa2-ddf995cfb232 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_ef370558-79d6-4859-a992-05984241db89" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 363570ed-b863-44c8-b616-184ae1d6270c (dataset): DatasetConfig { id: 363570ed-b863-44c8-b616-184ae1d6270c (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36c0c579-07c8-46a9-90f5-5f8306fd000c (dataset): DatasetConfig { id: 36c0c579-07c8-46a9-90f5-5f8306fd000c (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38f6ebc6-150c-4ff9-8a1b-405ec420d1ec (dataset): DatasetConfig { id: 38f6ebc6-150c-4ff9-8a1b-405ec420d1ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a6e796d-d46c-4306-ab9b-1e464c6d7d42 (dataset): DatasetConfig { id: 3a6e796d-d46c-4306-ab9b-1e464c6d7d42 (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3abed93e-61d3-40b8-9375-7e002e743233 (dataset): DatasetConfig { id: 3abed93e-61d3-40b8-9375-7e002e743233 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ccfb568-3395-462f-800a-1526cd106cd4 (dataset): DatasetConfig { id: 3ccfb568-3395-462f-800a-1526cd106cd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 467d34b2-3acc-4a43-9627-11f0f8633902 (dataset): DatasetConfig { id: 467d34b2-3acc-4a43-9627-11f0f8633902 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a00d649-feaa-4a60-9a58-5e1ab81a9bec (dataset): DatasetConfig { id: 4a00d649-feaa-4a60-9a58-5e1ab81a9bec (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4bb5df73-4eef-4eca-a2b9-6e88d7415d57 (dataset): DatasetConfig { id: 4bb5df73-4eef-4eca-a2b9-6e88d7415d57 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4d97d01a-b541-469f-87ae-06ded72b9747 (dataset): DatasetConfig { id: 4d97d01a-b541-469f-87ae-06ded72b9747 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 52d3b321-7fec-4d3b-bf68-0d6d2ce5d09c (dataset): DatasetConfig { id: 52d3b321-7fec-4d3b-bf68-0d6d2ce5d09c (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54058a96-03a4-40b8-863e-1966e963e04d (dataset): DatasetConfig { id: 54058a96-03a4-40b8-863e-1966e963e04d (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54d04c40-82f0-42ec-921b-45a69acf9830 (dataset): DatasetConfig { id: 54d04c40-82f0-42ec-921b-45a69acf9830 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 56e44cbf-55e0-45ce-8660-a720459ed416 (dataset): DatasetConfig { id: 56e44cbf-55e0-45ce-8660-a720459ed416 (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57cdd183-f3ed-405e-8cf1-8beb66bebade (dataset): DatasetConfig { id: 57cdd183-f3ed-405e-8cf1-8beb66bebade (dataset), name: DatasetName { pool_name: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f4a2c50-8404-4b28-ac4a-a7f0bd0dc147 (dataset): DatasetConfig { id: 5f4a2c50-8404-4b28-ac4a-a7f0bd0dc147 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68ff2607-2cd9-4c22-9e41-83227ece901d (dataset): DatasetConfig { id: 68ff2607-2cd9-4c22-9e41-83227ece901d (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e89c737-e228-4e7b-a18c-34d40cf94c2a (dataset): DatasetConfig { id: 6e89c737-e228-4e7b-a18c-34d40cf94c2a (dataset), name: DatasetName { pool_name: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7145ae5e-1767-4bec-bf3b-2ec5f4277f6e (dataset): DatasetConfig { id: 7145ae5e-1767-4bec-bf3b-2ec5f4277f6e (dataset), name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 75fa9a30-d61d-4142-9b4c-c64833a76bb5 (dataset): DatasetConfig { id: 75fa9a30-d61d-4142-9b4c-c64833a76bb5 (dataset), name: DatasetName { pool_name: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 77d45e9d-bfa8-45fb-a9c1-5580b9ef61dd (dataset): DatasetConfig { id: 77d45e9d-bfa8-45fb-a9c1-5580b9ef61dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7bdec283-9435-4924-bedd-9870e784d964 (dataset): DatasetConfig { id: 7bdec283-9435-4924-bedd-9870e784d964 (dataset), name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c109b72-0d91-4e3f-90b0-a8b8d841ad5c (dataset): DatasetConfig { id: 7c109b72-0d91-4e3f-90b0-a8b8d841ad5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80c06596-29e5-4500-ac99-8fed867e16f2 (dataset): DatasetConfig { id: 80c06596-29e5-4500-ac99-8fed867e16f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 81874b9a-e81e-4d10-abe5-1a3c62fd6a1c (dataset): DatasetConfig { id: 81874b9a-e81e-4d10-abe5-1a3c62fd6a1c (dataset), name: DatasetName { pool_name: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 842f935d-19d2-47a2-a7c1-022a2c876158 (dataset): DatasetConfig { id: 842f935d-19d2-47a2-a7c1-022a2c876158 (dataset), name: DatasetName { pool_name: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8511980e-a6aa-4bca-96bd-6b7117455d1d (dataset): DatasetConfig { id: 8511980e-a6aa-4bca-96bd-6b7117455d1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86332165-5154-41ec-af7c-16f3f176af42 (dataset): DatasetConfig { id: 86332165-5154-41ec-af7c-16f3f176af42 (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8eada516-5a05-4cda-8ee4-8ad94c7d0f71 (dataset): DatasetConfig { id: 8eada516-5a05-4cda-8ee4-8ad94c7d0f71 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7abd1c1-e727-4792-bd50-d64798a999da (dataset): DatasetConfig { id: a7abd1c1-e727-4792-bd50-d64798a999da (dataset), name: DatasetName { pool_name: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a99a4962-65f9-40fc-97b3-1a1a79a71262 (dataset): DatasetConfig { id: a99a4962-65f9-40fc-97b3-1a1a79a71262 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac4a8daf-409b-4a1f-8d71-95b7b50778a3 (dataset): DatasetConfig { id: ac4a8daf-409b-4a1f-8d71-95b7b50778a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b082ab8a-74bd-43f9-bf02-a825f8d06a6e (dataset): DatasetConfig { id: b082ab8a-74bd-43f9-bf02-a825f8d06a6e (dataset), name: DatasetName { pool_name: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b93f21ab-dd2f-46b3-8c94-76545ce8f8ca (dataset): DatasetConfig { id: b93f21ab-dd2f-46b3-8c94-76545ce8f8ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c752116a-9606-45a4-954a-37bf437b90be (dataset): DatasetConfig { id: c752116a-9606-45a4-954a-37bf437b90be (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c8a55a46-5bdb-4867-852a-8ed1af392f97 (dataset): DatasetConfig { id: c8a55a46-5bdb-4867-852a-8ed1af392f97 (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5c83715-fa12-468a-a41a-f3d74a37a5c8 (dataset): DatasetConfig { id: d5c83715-fa12-468a-a41a-f3d74a37a5c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d6f30621-43b5-4926-a888-5c2ed312326d (dataset): DatasetConfig { id: d6f30621-43b5-4926-a888-5c2ed312326d (dataset), name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e72241cf-c57a-4f87-ab8f-e0dc7a336602 (dataset): DatasetConfig { id: e72241cf-c57a-4f87-ab8f-e0dc7a336602 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ebeeb215-2f8e-4172-901e-fd9b04c74b05 (dataset): DatasetConfig { id: ebeeb215-2f8e-4172-901e-fd9b04c74b05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eed519a4-60f5-4abc-94c1-15bc5d38925c (dataset): DatasetConfig { id: eed519a4-60f5-4abc-94c1-15bc5d38925c (dataset), name: DatasetName { pool_name: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1cf0e1e-5891-4d75-ab61-3f64b9434844 (dataset): DatasetConfig { id: f1cf0e1e-5891-4d75-ab61-3f64b9434844 (dataset), name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3306b96-43f2-4c84-b847-1d4a6d2e4b56 (dataset): DatasetConfig { id: f3306b96-43f2-4c84-b847-1d4a6d2e4b56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f76cf4f8-71de-46f5-82f3-c1d7e29a33f6 (dataset): DatasetConfig { id: f76cf4f8-71de-46f5-82f3-c1d7e29a33f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4452024-12-12T22:31:03.309ZINFOSledAgent (StorageManager): No ledger in /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4462024-12-12T22:31:03.309ZINFOSledAgent (StorageManager): No ledger in /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472024-12-12T22:31:03.309ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4482024-12-12T22:31:03.309ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4492024-12-12T22:31:03.309ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/06e7bad6-773d-4089-9ade-6e4f457beccc/crypt/debug"), full_name: "oxp_06e7bad6-773d-4089-9ade-6e4f457beccc/crypt/debug" } file = sled-storage/src/manager.rs:1331
4502024-12-12T22:31:03.370ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/4a8c9490-d35a-4221-8585-e4103b325118) file = sled-agent/src/probe_manager.rs:231 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
4512024-12-12T22:31:03.378ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4522024-12-12T22:31:03.378ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/zone/oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579"), full_name: "oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/zone/oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579" } file = sled-storage/src/manager.rs:1331
4532024-12-12T22:31:03.481ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4542024-12-12T22:31:03.481ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3c596d62-0729-49f7-ab54-437e3babc937/crypt/zone/oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b"), full_name: "oxp_3c596d62-0729-49f7-ab54-437e3babc937/crypt/zone/oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b" } file = sled-storage/src/manager.rs:1331
4552024-12-12T22:31:03.582ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4562024-12-12T22:31:03.582ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/662d717a-a0c0-4538-854a-f7813f739fb9/crypt/zone/oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b"), full_name: "oxp_662d717a-a0c0-4538-854a-f7813f739fb9/crypt/zone/oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b" } file = sled-storage/src/manager.rs:1331
4572024-12-12T22:31:03.680ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4582024-12-12T22:31:03.680ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8ec50946-b029-4583-84f3-35d2ce5b9dff/crucible" } file = sled-storage/src/manager.rs:1331
4592024-12-12T22:31:03.768ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4602024-12-12T22:31:03.768ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/zone/oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f"), full_name: "oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/zone/oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f" } file = sled-storage/src/manager.rs:1331
4612024-12-12T22:31:03.867ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4622024-12-12T22:31:03.867ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_06e7bad6-773d-4089-9ade-6e4f457beccc/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4632024-12-12T22:31:03.958ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4642024-12-12T22:31:03.958ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
4652024-12-12T22:31:04.050ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4662024-12-12T22:31:04.050ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/zone/oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc"), full_name: "oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/zone/oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc" } file = sled-storage/src/manager.rs:1331
4672024-12-12T22:31:04.149ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4682024-12-12T22:31:04.149ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0101354b-4aed-4a3c-aa42-78e2e2510c9b/crypt/zone/oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142"), full_name: "oxp_0101354b-4aed-4a3c-aa42-78e2e2510c9b/crypt/zone/oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142" } file = sled-storage/src/manager.rs:1331
4692024-12-12T22:31:04.248ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4702024-12-12T22:31:04.248ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3c596d62-0729-49f7-ab54-437e3babc937/crypt/zone/oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db"), full_name: "oxp_3c596d62-0729-49f7-ab54-437e3babc937/crypt/zone/oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db" } file = sled-storage/src/manager.rs:1331
4712024-12-12T22:31:04.348ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4722024-12-12T22:31:04.348ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_662d717a-a0c0-4538-854a-f7813f739fb9/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4732024-12-12T22:31:04.371ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/4a8c9490-d35a-4221-8585-e4103b325118) file = sled-agent/src/probe_manager.rs:231 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
4742024-12-12T22:31:04.440ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4752024-12-12T22:31:04.440ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4762024-12-12T22:31:04.531ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4772024-12-12T22:31:04.531ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3c596d62-0729-49f7-ab54-437e3babc937/crypt/zone"), full_name: "oxp_3c596d62-0729-49f7-ab54-437e3babc937/crypt/zone" } file = sled-storage/src/manager.rs:1331
4782024-12-12T22:31:04.601ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4792024-12-12T22:31:04.601ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0101354b-4aed-4a3c-aa42-78e2e2510c9b/crypt/zone"), full_name: "oxp_0101354b-4aed-4a3c-aa42-78e2e2510c9b/crypt/zone" } file = sled-storage/src/manager.rs:1331
4802024-12-12T22:31:04.671ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4812024-12-12T22:31:04.671ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/zone/oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), full_name: "oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/zone/oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d" } file = sled-storage/src/manager.rs:1331
4822024-12-12T22:31:04.770ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4832024-12-12T22:31:04.770ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/zone/oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), full_name: "oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/zone/oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a" } file = sled-storage/src/manager.rs:1331
4842024-12-12T22:31:04.867ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4852024-12-12T22:31:04.867ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/zone/oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f"), full_name: "oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/zone/oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f" } file = sled-storage/src/manager.rs:1331
4862024-12-12T22:31:04.964ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4872024-12-12T22:31:04.964ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/zone/oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad"), full_name: "oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/zone/oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad" } file = sled-storage/src/manager.rs:1331
4882024-12-12T22:31:05.059ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4892024-12-12T22:31:05.059ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3c596d62-0729-49f7-ab54-437e3babc937/crucible" } file = sled-storage/src/manager.rs:1331
4902024-12-12T22:31:05.145ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4912024-12-12T22:31:05.145ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/662d717a-a0c0-4538-854a-f7813f739fb9/crypt/zone"), full_name: "oxp_662d717a-a0c0-4538-854a-f7813f739fb9/crypt/zone" } file = sled-storage/src/manager.rs:1331
4922024-12-12T22:31:05.211ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4932024-12-12T22:31:05.211ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/06e7bad6-773d-4089-9ade-6e4f457beccc/crypt/zone/oxz_ntp_ef370558-79d6-4859-a992-05984241db89"), full_name: "oxp_06e7bad6-773d-4089-9ade-6e4f457beccc/crypt/zone/oxz_ntp_ef370558-79d6-4859-a992-05984241db89" } file = sled-storage/src/manager.rs:1331
4942024-12-12T22:31:05.310ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4952024-12-12T22:31:05.310ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908/crucible" } file = sled-storage/src/manager.rs:1331
4962024-12-12T22:31:05.373ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/4a8c9490-d35a-4221-8585-e4103b325118) file = sled-agent/src/probe_manager.rs:231 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
4972024-12-12T22:31:05.396ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4982024-12-12T22:31:05.396ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8ec50946-b029-4583-84f3-35d2ce5b9dff/crypt/zone"), full_name: "oxp_8ec50946-b029-4583-84f3-35d2ce5b9dff/crypt/zone" } file = sled-storage/src/manager.rs:1331
4992024-12-12T22:31:05.462ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5002024-12-12T22:31:05.462ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_662d717a-a0c0-4538-854a-f7813f739fb9/crucible" } file = sled-storage/src/manager.rs:1331
5012024-12-12T22:31:05.548ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5022024-12-12T22:31:05.548ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/662d717a-a0c0-4538-854a-f7813f739fb9/crypt/debug"), full_name: "oxp_662d717a-a0c0-4538-854a-f7813f739fb9/crypt/debug" } file = sled-storage/src/manager.rs:1331
5032024-12-12T22:31:05.615ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5042024-12-12T22:31:05.615ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/06e7bad6-773d-4089-9ade-6e4f457beccc/crypt/zone"), full_name: "oxp_06e7bad6-773d-4089-9ade-6e4f457beccc/crypt/zone" } file = sled-storage/src/manager.rs:1331
5052024-12-12T22:31:05.682ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5062024-12-12T22:31:05.682ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8146c792-6a91-4f87-a5d5-73980d0b7ba5/crypt/zone/oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df"), full_name: "oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5/crypt/zone/oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df" } file = sled-storage/src/manager.rs:1331
5072024-12-12T22:31:05.780ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5082024-12-12T22:31:05.780ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/06e7bad6-773d-4089-9ade-6e4f457beccc/crypt/zone/oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4"), full_name: "oxp_06e7bad6-773d-4089-9ade-6e4f457beccc/crypt/zone/oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4" } file = sled-storage/src/manager.rs:1331
5092024-12-12T22:31:05.878ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5102024-12-12T22:31:05.878ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5112024-12-12T22:31:05.966ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5122024-12-12T22:31:05.966ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/debug"), full_name: "oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/debug" } file = sled-storage/src/manager.rs:1331
5132024-12-12T22:31:06.034ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5142024-12-12T22:31:06.034ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/06e7bad6-773d-4089-9ade-6e4f457beccc/crypt/zone/oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03"), full_name: "oxp_06e7bad6-773d-4089-9ade-6e4f457beccc/crypt/zone/oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03" } file = sled-storage/src/manager.rs:1331
5152024-12-12T22:31:06.133ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5162024-12-12T22:31:06.133ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5172024-12-12T22:31:06.222ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5182024-12-12T22:31:06.222ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/662d717a-a0c0-4538-854a-f7813f739fb9/crypt/zone/oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900"), full_name: "oxp_662d717a-a0c0-4538-854a-f7813f739fb9/crypt/zone/oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900" } file = sled-storage/src/manager.rs:1331
5192024-12-12T22:31:06.321ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5202024-12-12T22:31:06.321ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/06e7bad6-773d-4089-9ade-6e4f457beccc/crypt/zone/oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f"), full_name: "oxp_06e7bad6-773d-4089-9ade-6e4f457beccc/crypt/zone/oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f" } file = sled-storage/src/manager.rs:1331
5212024-12-12T22:31:06.376ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/4a8c9490-d35a-4221-8585-e4103b325118) file = sled-agent/src/probe_manager.rs:231 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
5222024-12-12T22:31:06.416ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5232024-12-12T22:31:06.417ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/662d717a-a0c0-4538-854a-f7813f739fb9/crypt/zone/oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d"), full_name: "oxp_662d717a-a0c0-4538-854a-f7813f739fb9/crypt/zone/oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d" } file = sled-storage/src/manager.rs:1331
5242024-12-12T22:31:06.515ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5252024-12-12T22:31:06.515ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ffe707ac-7f49-497d-beef-33098ae2bcc4/crypt/zone"), full_name: "oxp_ffe707ac-7f49-497d-beef-33098ae2bcc4/crypt/zone" } file = sled-storage/src/manager.rs:1331
5262024-12-12T22:31:06.580ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5272024-12-12T22:31:06.580ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5282024-12-12T22:31:06.676ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5292024-12-12T22:31:06.676ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/zone"), full_name: "oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/zone" } file = sled-storage/src/manager.rs:1331
5302024-12-12T22:31:06.744ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5312024-12-12T22:31:06.744ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0101354b-4aed-4a3c-aa42-78e2e2510c9b/crypt/zone/oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c"), full_name: "oxp_0101354b-4aed-4a3c-aa42-78e2e2510c9b/crypt/zone/oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c" } file = sled-storage/src/manager.rs:1331
5322024-12-12T22:31:06.842ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5332024-12-12T22:31:06.842ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8146c792-6a91-4f87-a5d5-73980d0b7ba5/crypt/zone"), full_name: "oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5/crypt/zone" } file = sled-storage/src/manager.rs:1331
5342024-12-12T22:31:06.908ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5352024-12-12T22:31:06.908ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ffe707ac-7f49-497d-beef-33098ae2bcc4/crypt/debug"), full_name: "oxp_ffe707ac-7f49-497d-beef-33098ae2bcc4/crypt/debug" } file = sled-storage/src/manager.rs:1331
5362024-12-12T22:31:06.976ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5372024-12-12T22:31:06.976ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0101354b-4aed-4a3c-aa42-78e2e2510c9b/crucible" } file = sled-storage/src/manager.rs:1331
5382024-12-12T22:31:07.062ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5392024-12-12T22:31:07.062ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_06e7bad6-773d-4089-9ade-6e4f457beccc/crucible" } file = sled-storage/src/manager.rs:1331
5402024-12-12T22:31:07.152ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5412024-12-12T22:31:07.152ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/zone/oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d"), full_name: "oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/zone/oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d" } file = sled-storage/src/manager.rs:1331
5422024-12-12T22:31:07.247ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5432024-12-12T22:31:07.247ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/debug"), full_name: "oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/debug" } file = sled-storage/src/manager.rs:1331
5442024-12-12T22:31:07.313ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5452024-12-12T22:31:07.313ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ffe707ac-7f49-497d-beef-33098ae2bcc4/crucible" } file = sled-storage/src/manager.rs:1331
5462024-12-12T22:31:07.378ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/4a8c9490-d35a-4221-8585-e4103b325118) file = sled-agent/src/probe_manager.rs:231 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
5472024-12-12T22:31:07.400ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5482024-12-12T22:31:07.400ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ffe707ac-7f49-497d-beef-33098ae2bcc4/crypt/zone/oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675"), full_name: "oxp_ffe707ac-7f49-497d-beef-33098ae2bcc4/crypt/zone/oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675" } file = sled-storage/src/manager.rs:1331
5492024-12-12T22:31:07.500ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5502024-12-12T22:31:07.500ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5/crucible" } file = sled-storage/src/manager.rs:1331
5512024-12-12T22:31:07.586ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5522024-12-12T22:31:07.586ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
5532024-12-12T22:31:07.679ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5542024-12-12T22:31:07.679ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5552024-12-12T22:31:07.770ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5562024-12-12T22:31:07.770ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3c596d62-0729-49f7-ab54-437e3babc937/crypt/debug"), full_name: "oxp_3c596d62-0729-49f7-ab54-437e3babc937/crypt/debug" } file = sled-storage/src/manager.rs:1331
5572024-12-12T22:31:07.838ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5582024-12-12T22:31:07.838ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8146c792-6a91-4f87-a5d5-73980d0b7ba5/crypt/zone/oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974"), full_name: "oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5/crypt/zone/oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974" } file = sled-storage/src/manager.rs:1331
5592024-12-12T22:31:07.936ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5602024-12-12T22:31:07.936ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8ec50946-b029-4583-84f3-35d2ce5b9dff/crypt/debug"), full_name: "oxp_8ec50946-b029-4583-84f3-35d2ce5b9dff/crypt/debug" } file = sled-storage/src/manager.rs:1331
5612024-12-12T22:31:08.030ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5622024-12-12T22:31:08.030ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8ec50946-b029-4583-84f3-35d2ce5b9dff/crypt/zone/oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853"), full_name: "oxp_8ec50946-b029-4583-84f3-35d2ce5b9dff/crypt/zone/oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853" } file = sled-storage/src/manager.rs:1331
5632024-12-12T22:31:08.130ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5642024-12-12T22:31:08.130ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/zone"), full_name: "oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/zone" } file = sled-storage/src/manager.rs:1331
5652024-12-12T22:31:08.203ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5662024-12-12T22:31:08.203ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/zone/oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb"), full_name: "oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/zone/oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb" } file = sled-storage/src/manager.rs:1331
5672024-12-12T22:31:08.299ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5682024-12-12T22:31:08.299ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_662d717a-a0c0-4538-854a-f7813f739fb9/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5692024-12-12T22:31:08.380ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/4a8c9490-d35a-4221-8585-e4103b325118) file = sled-agent/src/probe_manager.rs:231 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
5702024-12-12T22:31:08.389ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5712024-12-12T22:31:08.389ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8146c792-6a91-4f87-a5d5-73980d0b7ba5/crypt/debug"), full_name: "oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5/crypt/debug" } file = sled-storage/src/manager.rs:1331
5722024-12-12T22:31:08.459ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5732024-12-12T22:31:08.459ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crucible" } file = sled-storage/src/manager.rs:1331
5742024-12-12T22:31:08.548ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5752024-12-12T22:31:08.548ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0101354b-4aed-4a3c-aa42-78e2e2510c9b/crypt/debug"), full_name: "oxp_0101354b-4aed-4a3c-aa42-78e2e2510c9b/crypt/debug" } file = sled-storage/src/manager.rs:1331
5762024-12-12T22:31:08.615ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5772024-12-12T22:31:08.615ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/662d717a-a0c0-4538-854a-f7813f739fb9/crypt/zone/oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25"), full_name: "oxp_662d717a-a0c0-4538-854a-f7813f739fb9/crypt/zone/oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25" } file = sled-storage/src/manager.rs:1331
5782024-12-12T22:31:08.722ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5792024-12-12T22:31:08.722ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ffe707ac-7f49-497d-beef-33098ae2bcc4/crypt/zone/oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa"), full_name: "oxp_ffe707ac-7f49-497d-beef-33098ae2bcc4/crypt/zone/oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa" } file = sled-storage/src/manager.rs:1331
5802024-12-12T22:31:08.820ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5812024-12-12T22:31:08.820ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/zone/oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c"), full_name: "oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/zone/oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c" } file = sled-storage/src/manager.rs:1331
5822024-12-12T22:31:08.916ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5832024-12-12T22:31:08.916ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5842024-12-12T22:31:08.999ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5852024-12-12T22:31:08.999ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/662d717a-a0c0-4538-854a-f7813f739fb9/crypt/zone/oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc"), full_name: "oxp_662d717a-a0c0-4538-854a-f7813f739fb9/crypt/zone/oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc" } file = sled-storage/src/manager.rs:1331
5862024-12-12T22:31:09.030ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1942627166372905777 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
5872024-12-12T22:31:09.030ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12860365929060177652 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
5882024-12-12T22:31:09.097ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
5892024-12-12T22:31:09.101ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
5902024-12-12T22:31:09.101ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
5912024-12-12T22:31:09.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5793071 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56904 req_id = 7f138047-8726-40f9-8784-f78e1f3db18c response_code = 200 uri = /datasets
5922024-12-12T22:31:09.123ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5932024-12-12T22:31:09.123ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5942024-12-12T22:31:09.130ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
5952024-12-12T22:31:09.130ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
5962024-12-12T22:31:09.141ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 274d5912-4a70-4fa9-bda4-a3ea3c10fa1d (service), filesystem_pool: Some(ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: c29982ca-1c1c-420b-ace3-c75702fa0579 (service), filesystem_pool: Some(ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 7160cbb3-b56f-4e07-9380-65c1eba185bc (service), filesystem_pool: Some(ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
5972024-12-12T22:31:09.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43885
5982024-12-12T22:31:09.141ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 274d5912-4a70-4fa9-bda4-a3ea3c10fa1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
5992024-12-12T22:31:09.141ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 274d5912-4a70-4fa9-bda4-a3ea3c10fa1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6002024-12-12T22:31:09.178ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c29982ca-1c1c-420b-ace3-c75702fa0579, dataset_name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6012024-12-12T22:31:09.178ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c29982ca-1c1c-420b-ace3-c75702fa0579, dataset_name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6022024-12-12T22:31:09.212ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7160cbb3-b56f-4e07-9380-65c1eba185bc, dataset_name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6032024-12-12T22:31:09.212ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7160cbb3-b56f-4e07-9380-65c1eba185bc, dataset_name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6042024-12-12T22:31:09.249ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6052024-12-12T22:31:09.249ZINFOSledAgent (ServiceManager): No ledger in /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/omicron-zones.json file = common/src/ledger.rs:188
6062024-12-12T22:31:09.249ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/omicron-zones.json file = common/src/ledger.rs:188
6072024-12-12T22:31:09.249ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6082024-12-12T22:31:09.287ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
6092024-12-12T22:31:09.287ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
6102024-12-12T22:31:09.297ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6112024-12-12T22:31:09.297ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6122024-12-12T22:31:09.297ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6132024-12-12T22:31:09.333ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
6142024-12-12T22:31:09.333ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
6152024-12-12T22:31:09.360ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc file = illumos-utils/src/zone.rs:325
6162024-12-12T22:31:09.365ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d file = illumos-utils/src/zone.rs:325
6172024-12-12T22:31:09.371ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579 file = illumos-utils/src/zone.rs:325
6182024-12-12T22:31:09.382ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc file = illumos-utils/src/zone.rs:363
6192024-12-12T22:31:09.387ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/4a8c9490-d35a-4221-8585-e4103b325118) file = sled-agent/src/probe_manager.rs:231 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
6202024-12-12T22:31:09.387ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d file = illumos-utils/src/zone.rs:363
6212024-12-12T22:31:09.390ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6222024-12-12T22:31:09.390ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6232024-12-12T22:31:09.393ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579 file = illumos-utils/src/zone.rs:363
6242024-12-12T22:31:09.412ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6252024-12-12T22:31:09.412ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6262024-12-12T22:31:09.494ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6272024-12-12T22:31:09.494ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6282024-12-12T22:31:09.633ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6292024-12-12T22:31:09.633ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6302024-12-12T22:31:09.676ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6312024-12-12T22:31:09.677ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/4a8c9490-d35a-4221-8585-e4103b325118) file = sled-agent/src/nexus.rs:527 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
6322024-12-12T22:31:09.730ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6332024-12-12T22:31:09.730ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6342024-12-12T22:31:09.730ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6352024-12-12T22:31:09.730ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6362024-12-12T22:31:09.771ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6372024-12-12T22:31:09.824ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6382024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6392024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6402024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6412024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6422024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6432024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6442024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6452024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6462024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6472024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6482024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6492024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6502024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6512024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6522024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6532024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6542024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6552024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6562024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6572024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6582024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6592024-12-12T22:31:09.824ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6602024-12-12T22:31:09.929ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.147415401s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
6612024-12-12T22:31:10.315ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11945109518193762894 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
6622024-12-12T22:31:10.315ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6364488794010925785 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
6632024-12-12T22:31:10.389ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/4a8c9490-d35a-4221-8585-e4103b325118) file = sled-agent/src/probe_manager.rs:231 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
6642024-12-12T22:31:11.018ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6652024-12-12T22:31:11.018ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6662024-12-12T22:31:11.019ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc
6672024-12-12T22:31:11.506ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6682024-12-12T22:31:11.984ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6692024-12-12T22:31:11.984ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6702024-12-12T22:31:11.984ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6712024-12-12T22:31:11.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc") failed: Property not found. retry in 52.511187ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc
6722024-12-12T22:31:11.995ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d
6732024-12-12T22:31:12.000ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579
6742024-12-12T22:31:12.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc") failed: Property not found. retry in 73.441604ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc
6752024-12-12T22:31:12.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d") failed: Property not found. retry in 27.519469ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d
6762024-12-12T22:31:12.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc") failed: Property not found. retry in 220.456533ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc
6772024-12-12T22:31:12.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579") failed: Property not found. retry in 65.023838ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579
6782024-12-12T22:31:12.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d") failed: Property not found. retry in 53.465223ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d
6792024-12-12T22:31:12.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579") failed: Property not found. retry in 77.514605ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579
6802024-12-12T22:31:12.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d") failed: Property not found. retry in 141.165218ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d
6812024-12-12T22:31:12.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc") failed: Property not found. retry in 555.495217ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc
6822024-12-12T22:31:12.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579") failed: Property not found. retry in 284.352095ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579
6832024-12-12T22:31:12.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d") failed: Property not found. retry in 461.551097ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d
6842024-12-12T22:31:12.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579") failed: Property not found. retry in 452.852762ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579
6852024-12-12T22:31:12.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc") failed: Property not found. retry in 965.057484ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc
6862024-12-12T22:31:12.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d") failed: Property not found. retry in 1.093809924s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d
6872024-12-12T22:31:13.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579") failed: Property not found. retry in 1.072654604s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579
6882024-12-12T22:31:13.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc") failed: Property not found. retry in 1.228706895s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc
6892024-12-12T22:31:14.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d") failed: Property not found. retry in 1.280654358s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d
6902024-12-12T22:31:14.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579") failed: Property not found. retry in 1.192593198s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579
6912024-12-12T22:31:15.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc") failed: Property not found. retry in 644.708075ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc
6922024-12-12T22:31:15.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d") failed: Property not found. retry in 678.965375ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d
6932024-12-12T22:31:15.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579") failed: Property not found. retry in 1.269227126s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579
6942024-12-12T22:31:15.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc") failed: Property not found. retry in 1.255038029s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc
6952024-12-12T22:31:16.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d") failed: Property not found. retry in 1.127954894s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d
6962024-12-12T22:31:16.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579") failed: Property not found. retry in 900.07374ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579
6972024-12-12T22:31:17.672ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_7160cbb3-b56f-4e07-9380-65c1eba185bc
6982024-12-12T22:31:17.672ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_274d5912-4a70-4fa9-bda4-a3ea3c10fa1d
6992024-12-12T22:31:17.672ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_c29982ca-1c1c-420b-ace3-c75702fa0579
7002024-12-12T22:31:17.672ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7012024-12-12T22:31:17.672ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7022024-12-12T22:31:17.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8531250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43885 req_id = 4ff6369d-8461-49fb-b030-4bb969502d7e response_code = 204 uri = /omicron-zones
7032024-12-12T22:31:17.674ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7042024-12-12T22:31:17.889ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 50.481383ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7052024-12-12T22:31:17.940ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 99.04189ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7062024-12-12T22:31:18.058ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7072024-12-12T22:31:18.113ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7082024-12-12T22:31:18.167ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7092024-12-12T22:31:18.167ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7102024-12-12T22:31:18.198ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7112024-12-12T22:31:18.199ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7122024-12-12T22:31:18.199ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7132024-12-12T22:31:18.228ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 274d5912-4a70-4fa9-bda4-a3ea3c10fa1d (service), filesystem_pool: Some(ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: c29982ca-1c1c-420b-ace3-c75702fa0579 (service), filesystem_pool: Some(ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 7160cbb3-b56f-4e07-9380-65c1eba185bc (service), filesystem_pool: Some(ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ef370558-79d6-4859-a992-05984241db89 (service), filesystem_pool: Some(ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 5e32d2e4-482f-4c9b-9df6-ae9289017180, kind: Service { id: ef370558-79d6-4859-a992-05984241db89 }, name: Name("ntp-ef370558-79d6-4859-a992-05984241db89"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 142])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7142024-12-12T22:31:18.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58357
7152024-12-12T22:31:18.229ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 274d5912-4a70-4fa9-bda4-a3ea3c10fa1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7162024-12-12T22:31:18.229ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 274d5912-4a70-4fa9-bda4-a3ea3c10fa1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7172024-12-12T22:31:18.268ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c29982ca-1c1c-420b-ace3-c75702fa0579, dataset_name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7182024-12-12T22:31:18.268ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c29982ca-1c1c-420b-ace3-c75702fa0579, dataset_name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7192024-12-12T22:31:18.305ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7160cbb3-b56f-4e07-9380-65c1eba185bc, dataset_name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7202024-12-12T22:31:18.305ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7160cbb3-b56f-4e07-9380-65c1eba185bc, dataset_name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7212024-12-12T22:31:18.341ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7222024-12-12T22:31:18.341ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/omicron-zones.json file = common/src/ledger.rs:177
7232024-12-12T22:31:18.341ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/omicron-zones.json file = common/src/ledger.rs:177
7242024-12-12T22:31:18.341ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7252024-12-12T22:31:18.352ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7262024-12-12T22:31:18.385ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7272024-12-12T22:31:18.386ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7282024-12-12T22:31:18.386ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7292024-12-12T22:31:18.415ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 144, 142]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7302024-12-12T22:31:18.415ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = boundary_ntp
7312024-12-12T22:31:18.416ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7322024-12-12T22:31:18.416ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7332024-12-12T22:31:18.416ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7342024-12-12T22:31:18.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7352024-12-12T22:31:18.440ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_ef370558-79d6-4859-a992-05984241db89 file = illumos-utils/src/zone.rs:325
7362024-12-12T22:31:18.459ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_ef370558-79d6-4859-a992-05984241db89 file = illumos-utils/src/zone.rs:363
7372024-12-12T22:31:19.033ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1942627166372905777 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
7382024-12-12T22:31:19.033ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12860365929060177652 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
7392024-12-12T22:31:19.067ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_ef370558-79d6-4859-a992-05984241db89: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7402024-12-12T22:31:19.067ZINFOSledAgent (ServiceManager): Booting oxz_ntp_ef370558-79d6-4859-a992-05984241db89 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_ef370558-79d6-4859-a992-05984241db89
7412024-12-12T22:31:19.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ef370558-79d6-4859-a992-05984241db89") failed: Property not found. retry in 56.319397ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ef370558-79d6-4859-a992-05984241db89
7422024-12-12T22:31:19.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ef370558-79d6-4859-a992-05984241db89") failed: Property not found. retry in 125.0273ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ef370558-79d6-4859-a992-05984241db89
7432024-12-12T22:31:19.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ef370558-79d6-4859-a992-05984241db89") failed: Property not found. retry in 173.763308ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ef370558-79d6-4859-a992-05984241db89
7442024-12-12T22:31:19.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ef370558-79d6-4859-a992-05984241db89") failed: Property not found. retry in 538.195552ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ef370558-79d6-4859-a992-05984241db89
7452024-12-12T22:31:20.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ef370558-79d6-4859-a992-05984241db89") failed: Property not found. retry in 1.043156191s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ef370558-79d6-4859-a992-05984241db89
7462024-12-12T22:31:20.318ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11945109518193762894 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
7472024-12-12T22:31:20.318ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6364488794010925785 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
7482024-12-12T22:31:21.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ef370558-79d6-4859-a992-05984241db89") failed: Property not found. retry in 906.071123ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ef370558-79d6-4859-a992-05984241db89
7492024-12-12T22:31:22.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ef370558-79d6-4859-a992-05984241db89") failed: Property not found. retry in 612.317164ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ef370558-79d6-4859-a992-05984241db89
7502024-12-12T22:31:22.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ef370558-79d6-4859-a992-05984241db89") failed: Property not found. retry in 1.431110598s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ef370558-79d6-4859-a992-05984241db89
7512024-12-12T22:31:24.169ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_ef370558-79d6-4859-a992-05984241db89
7522024-12-12T22:31:24.169ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7532024-12-12T22:31:24.169ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7542024-12-12T22:31:24.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5940939 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58357 req_id = fb56fcea-e14f-435e-85f3-1fd57e2cf893 response_code = 204 uri = /omicron-zones
7552024-12-12T22:31:24.172ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
7562024-12-12T22:31:24.203ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7572024-12-12T22:31:24.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43762
7582024-12-12T22:31:24.213ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ef370558-79d6-4859-a992-05984241db89': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7592024-12-12T22:31:24.213ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9838 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43762 req_id = 28f86cce-f17f-4fe3-8231-9123a5415584 response_code = 500 uri = /timesync
7602024-12-12T22:31:24.216ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7612024-12-12T22:31:24.365ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7622024-12-12T22:31:24.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59668
7632024-12-12T22:31:27.121ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4328111800993955750 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
7642024-12-12T22:31:27.236ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1144492746958027542 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
7652024-12-12T22:31:27.674ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1120312021778769365 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
7662024-12-12T22:31:28.374ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ef370558-79d6-4859-a992-05984241db89': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7672024-12-12T22:31:28.374ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008915 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59668 req_id = c807e47a-583f-4e94-b525-07cb7a196f98 response_code = 500 uri = /timesync
7682024-12-12T22:31:28.377ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7692024-12-12T22:31:28.535ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7702024-12-12T22:31:28.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45580
7712024-12-12T22:31:28.543ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ef370558-79d6-4859-a992-05984241db89': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7722024-12-12T22:31:28.544ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8344 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45580 req_id = 163881ed-57be-492f-8b75-5d99e472db87 response_code = 500 uri = /timesync
7732024-12-12T22:31:28.547ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7742024-12-12T22:31:28.740ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7752024-12-12T22:31:28.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59399
7762024-12-12T22:31:28.749ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ef370558-79d6-4859-a992-05984241db89': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7772024-12-12T22:31:28.749ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8474 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59399 req_id = 6f150a7a-2750-412a-a5e5-a9dcb3e181bd response_code = 500 uri = /timesync
7782024-12-12T22:31:28.752ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7792024-12-12T22:31:28.908ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7802024-12-12T22:31:28.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42072
7812024-12-12T22:31:29.035ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1942627166372905777 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
7822024-12-12T22:31:29.035ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12860365929060177652 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
7832024-12-12T22:31:30.321ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11945109518193762894 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
7842024-12-12T22:31:30.321ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6364488794010925785 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
7852024-12-12T22:31:30.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008806 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42072 req_id = 5f12aad6-c60c-4d3b-a2d5-80cedd754ef7 response_code = 200 uri = /timesync
7862024-12-12T22:31:30.920ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
7872024-12-12T22:31:30.920ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7882024-12-12T22:31:30.228ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7892024-12-12T22:31:30.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64040
7902024-12-12T22:31:30.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8417 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64040 req_id = 8fb49174-5157-4893-b966-d89b92592df8 response_code = 200 uri = /timesync
7912024-12-12T22:31:30.240ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734042689.0936637, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
7922024-12-12T22:31:30.240ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7932024-12-12T22:31:30.432ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7942024-12-12T22:31:30.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55759
7952024-12-12T22:31:30.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55759 req_id = 4d8bf802-b329-4fbb-b007-869708661929 response_code = 200 uri = /timesync
7962024-12-12T22:31:30.444ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734042689.0936637, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
7972024-12-12T22:31:30.444ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7982024-12-12T22:31:31.247ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7992024-12-12T22:31:31.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54295
8002024-12-12T22:31:31.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8091 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54295 req_id = 9ea10403-33e8-4e54-a96a-e42a5eece063 response_code = 200 uri = /timesync
8012024-12-12T22:31:31.259ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734042689.0936637, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8022024-12-12T22:31:31.259ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8032024-12-12T22:31:31.224ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8042024-12-12T22:31:31.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64579
8052024-12-12T22:31:31.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64579 req_id = 57a90e87-46dc-41e7-9014-3b7444129ed0 response_code = 200 uri = /timesync
8062024-12-12T22:31:31.235ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734042689.0936637, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8072024-12-12T22:31:31.235ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8082024-12-12T22:31:31.909ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8092024-12-12T22:31:31.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59499
8102024-12-12T22:31:31.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9825 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59499 req_id = 7e3f938a-dcd0-49b6-b83b-9cd1117306f6 response_code = 200 uri = /timesync
8112024-12-12T22:31:31.921ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734042689.0936637, correction: 0.299830347 } file = sled-agent/src/rack_setup/service.rs:743
8122024-12-12T22:31:31.921ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8132024-12-12T22:31:31.965ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 144.619595ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8142024-12-12T22:31:32.491ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8152024-12-12T22:31:32.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49916
8162024-12-12T22:31:32.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8325 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49916 req_id = cfeb5014-4482-48c3-94aa-cd5d3b452bc2 response_code = 200 uri = /timesync
8172024-12-12T22:31:32.502ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734042689.0936637, correction: 0.298264414 } file = sled-agent/src/rack_setup/service.rs:743
8182024-12-12T22:31:32.502ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8192024-12-12T22:31:33.012ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3310330337306242593 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8202024-12-12T22:31:33.012ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13684154738373954329 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8212024-12-12T22:31:33.069ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8222024-12-12T22:31:33.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51740
8232024-12-12T22:31:33.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7723 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51740 req_id = 710cbffe-bd11-48e9-848a-8fd8530f5896 response_code = 200 uri = /timesync
8242024-12-12T22:31:33.079ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734042689.0936637, correction: 0.297402918 } file = sled-agent/src/rack_setup/service.rs:743
8252024-12-12T22:31:33.079ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8262024-12-12T22:31:33.994ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8272024-12-12T22:31:33.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61088
8282024-12-12T22:31:34.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8830 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61088 req_id = b48fd91a-fd7d-48f1-a2c9-4bc19ffe0d6f response_code = 200 uri = /timesync
8292024-12-12T22:31:34.007ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734042689.0936637, correction: 0.293319076 } file = sled-agent/src/rack_setup/service.rs:743
8302024-12-12T22:31:34.007ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8312024-12-12T22:31:34.957ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8322024-12-12T22:31:34.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42230
8332024-12-12T22:31:34.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42230 req_id = 3c5d5341-5c00-423f-9f07-7d7c0f8c4b5d response_code = 200 uri = /timesync
8342024-12-12T22:31:34.969ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734042689.0936637, correction: 0.290078342 } file = sled-agent/src/rack_setup/service.rs:743
8352024-12-12T22:31:34.969ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8362024-12-12T22:31:35.970ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4328111800993955750 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8372024-12-12T22:31:36.085ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1144492746958027542 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8382024-12-12T22:31:36.318ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8392024-12-12T22:31:36.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40257
8402024-12-12T22:31:36.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40257 req_id = 8069fe9e-751d-4b03-84df-9af77921e42b response_code = 200 uri = /timesync
8412024-12-12T22:31:36.330ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734042695.4046712, correction: 0.285050094 } file = sled-agent/src/rack_setup/service.rs:743
8422024-12-12T22:31:36.330ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8432024-12-12T22:31:36.525ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1120312021778769365 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8442024-12-12T22:31:37.891ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1942627166372905777 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8452024-12-12T22:31:37.891ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12860365929060177652 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8462024-12-12T22:31:38.013ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8472024-12-12T22:31:38.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41374
8482024-12-12T22:31:38.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9411 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41374 req_id = 0dbdcae6-6cf6-46cf-8490-0e776a5ae254 response_code = 200 uri = /timesync
8492024-12-12T22:31:38.026ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734042697.7335842, correction: 0.280262202 } file = sled-agent/src/rack_setup/service.rs:743
8502024-12-12T22:31:38.026ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8512024-12-12T22:31:38.188ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60305
8522024-12-12T22:31:38.188ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60305 req_id = 4e366968-9e11-4e3c-b3ca-900d473db89b response_code = 200 uri = /baseboard
8532024-12-12T22:31:39.180ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11945109518193762894 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8542024-12-12T22:31:39.180ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6364488794010925785 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8552024-12-12T22:31:39.287ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8562024-12-12T22:31:39.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34036
8572024-12-12T22:31:39.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8696 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34036 req_id = 3387adee-c262-40ee-84e9-b38f27427bc5 response_code = 200 uri = /timesync
8582024-12-12T22:31:39.300ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734042699.0871265, correction: 0.276833415 } file = sled-agent/src/rack_setup/service.rs:743
8592024-12-12T22:31:39.300ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8602024-12-12T22:31:41.729ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8612024-12-12T22:31:41.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64842
8622024-12-12T22:31:41.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64842 req_id = eaf0c18e-238d-4ba3-898e-213033ccfa39 response_code = 200 uri = /timesync
8632024-12-12T22:31:41.742ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734042700.2058666, correction: 0.270275712 } file = sled-agent/src/rack_setup/service.rs:743
8642024-12-12T22:31:41.742ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8652024-12-12T22:31:43.042ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3310330337306242593 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8662024-12-12T22:31:43.042ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13684154738373954329 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8672024-12-12T22:31:44.626ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8682024-12-12T22:31:44.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47727
8692024-12-12T22:31:44.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8465 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47727 req_id = fa3643cb-2496-4671-b4ac-e8b1c7a36f45 response_code = 200 uri = /timesync
8702024-12-12T22:31:44.637ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734042703.5941958, correction: 0.262485713 } file = sled-agent/src/rack_setup/service.rs:743
8712024-12-12T22:31:44.637ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8722024-12-12T22:31:46.000ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4328111800993955750 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8732024-12-12T22:31:46.114ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1144492746958027542 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8742024-12-12T22:31:46.554ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1120312021778769365 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8752024-12-12T22:31:47.185ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 328.617429ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8762024-12-12T22:31:47.919ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1942627166372905777 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8772024-12-12T22:31:47.920ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12860365929060177652 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8782024-12-12T22:31:48.383ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8792024-12-12T22:31:48.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41315
8802024-12-12T22:31:48.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41315 req_id = a6966e86-d79b-4d01-af00-31190c20519b response_code = 200 uri = /timesync
8812024-12-12T22:31:48.395ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734042708.0820754, correction: 0.252273023 } file = sled-agent/src/rack_setup/service.rs:743
8822024-12-12T22:31:48.395ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8832024-12-12T22:31:49.210ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11945109518193762894 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8842024-12-12T22:31:49.210ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6364488794010925785 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8852024-12-12T22:31:52.539ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8862024-12-12T22:31:52.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41815
8872024-12-12T22:31:52.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9001 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41815 req_id = bbefc189-bd0e-47b3-8113-77b6b6d5c719 response_code = 200 uri = /timesync
8882024-12-12T22:31:52.553ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734042711.5685723, correction: 0.241045967 } file = sled-agent/src/rack_setup/service.rs:743
8892024-12-12T22:31:52.553ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8902024-12-12T22:31:53.072ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3310330337306242593 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8912024-12-12T22:31:53.072ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13684154738373954329 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8922024-12-12T22:31:55.438ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8932024-12-12T22:31:55.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53449
8942024-12-12T22:31:55.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53449 req_id = 9b05597e-a154-44cd-877a-4b44173e4bfc response_code = 200 uri = /timesync
8952024-12-12T22:31:55.450ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734042714.721824, correction: 0.233202025 } file = sled-agent/src/rack_setup/service.rs:743
8962024-12-12T22:31:55.450ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8972024-12-12T22:31:56.029ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4328111800993955750 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8982024-12-12T22:31:56.142ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1144492746958027542 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
8992024-12-12T22:31:56.582ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1120312021778769365 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9002024-12-12T22:31:57.948ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1942627166372905777 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9012024-12-12T22:31:57.949ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12860365929060177652 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9022024-12-12T22:31:59.239ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11945109518193762894 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9032024-12-12T22:31:59.239ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6364488794010925785 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9042024-12-12T22:32:01.052ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9052024-12-12T22:32:01.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63714
9062024-12-12T22:32:01.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9537 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63714 req_id = 9d581f7d-d391-43ce-bb40-600c010ef30f response_code = 200 uri = /timesync
9072024-12-12T22:32:01.066ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734042719.4138656, correction: 0.218010813 } file = sled-agent/src/rack_setup/service.rs:743
9082024-12-12T22:32:01.066ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9092024-12-12T22:32:02.592ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.404259586s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9102024-12-12T22:32:03.101ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3310330337306242593 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9112024-12-12T22:32:03.101ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13684154738373954329 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9122024-12-12T22:32:05.918ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9132024-12-12T22:32:05.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33989
9142024-12-12T22:32:05.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9416 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33989 req_id = f4f98479-239c-4082-84db-01fc1191f79f response_code = 200 uri = /timesync
9152024-12-12T22:32:05.931ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734042723.9882884, correction: 0.204856843 } file = sled-agent/src/rack_setup/service.rs:743
9162024-12-12T22:32:05.931ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9172024-12-12T22:32:06.058ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4328111800993955750 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9182024-12-12T22:32:06.170ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1144492746958027542 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9192024-12-12T22:32:06.610ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1120312021778769365 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9202024-12-12T22:32:07.978ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1942627166372905777 reason = Duration(60s) sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9212024-12-12T22:32:07.979ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 12860365929060177652 reason = Duration(60s) sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9222024-12-12T22:32:08.304ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49138
9232024-12-12T22:32:08.304ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49138 req_id = a1dd0b61-f17f-40f7-a098-dc15b2b2dab4 response_code = 200 uri = /baseboard
9242024-12-12T22:32:09.268ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11945109518193762894 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9252024-12-12T22:32:09.269ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6364488794010925785 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9262024-12-12T22:32:12.323ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9272024-12-12T22:32:12.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38403
9282024-12-12T22:32:12.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8874 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38403 req_id = c1da5f2c-657a-4d96-9920-320742cda1d3 response_code = 200 uri = /timesync
9292024-12-12T22:32:12.337ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734042729.6039448, correction: 0.187535226 } file = sled-agent/src/rack_setup/service.rs:743
9302024-12-12T22:32:12.337ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9312024-12-12T22:32:13.129ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3310330337306242593 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9322024-12-12T22:32:13.129ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13684154738373954329 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9332024-12-12T22:32:16.087ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4328111800993955750 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9342024-12-12T22:32:16.198ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1144492746958027542 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9352024-12-12T22:32:16.639ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1120312021778769365 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9362024-12-12T22:32:19.075ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.893225762s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9372024-12-12T22:32:19.297ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11945109518193762894 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9382024-12-12T22:32:19.297ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6364488794010925785 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9392024-12-12T22:32:23.159ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3310330337306242593 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9402024-12-12T22:32:23.159ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13684154738373954329 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9412024-12-12T22:32:24.292ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9422024-12-12T22:32:24.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50930
9432024-12-12T22:32:24.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9030 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50930 req_id = cbd86575-ca81-4b78-aaa4-56181f929478 response_code = 200 uri = /timesync
9442024-12-12T22:32:24.304ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734042737.830343, correction: 0.155220047 } file = sled-agent/src/rack_setup/service.rs:743
9452024-12-12T22:32:24.304ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9462024-12-12T22:32:26.117ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4328111800993955750 reason = Duration(60s) sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9472024-12-12T22:32:26.226ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1144492746958027542 reason = Duration(60s) sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9482024-12-12T22:32:26.668ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1120312021778769365 reason = Duration(60s) sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9492024-12-12T22:32:29.326ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11945109518193762894 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9502024-12-12T22:32:29.326ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6364488794010925785 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9512024-12-12T22:32:33.188ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3310330337306242593 reason = Duration(60s) sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9522024-12-12T22:32:33.188ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13684154738373954329 reason = Duration(60s) sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9532024-12-12T22:32:34.553ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9542024-12-12T22:32:34.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46394
9552024-12-12T22:32:34.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8349 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46394 req_id = 9ec3a782-18e0-4a6d-a47b-afcd8fc50cd7 response_code = 200 uri = /timesync
9562024-12-12T22:32:34.564ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734042753.6535337, correction: 0.127479032 } file = sled-agent/src/rack_setup/service.rs:743
9572024-12-12T22:32:34.564ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9582024-12-12T22:32:37.053ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.964202462s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9592024-12-12T22:32:38.419ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48465
9602024-12-12T22:32:38.419ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48465 req_id = 4e3084c6-a8ad-45d2-ba58-980532ef5bec response_code = 200 uri = /baseboard
9612024-12-12T22:32:39.355ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11945109518193762894 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9622024-12-12T22:32:39.355ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6364488794010925785 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9632024-12-12T22:32:49.384ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11945109518193762894 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9642024-12-12T22:32:49.384ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6364488794010925785 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9652024-12-12T22:32:50.435ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9662024-12-12T22:32:50.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39738
9672024-12-12T22:32:50.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8930 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39738 req_id = 8ca4cf67-0241-441e-a1dd-60ab857a4585 response_code = 200 uri = /timesync
9682024-12-12T22:32:50.447ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734042762.2464166, correction: 0.084580541 } file = sled-agent/src/rack_setup/service.rs:743
9692024-12-12T22:32:50.447ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9702024-12-12T22:32:57.105ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.859147833s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9712024-12-12T22:32:59.413ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11945109518193762894 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9722024-12-12T22:32:59.413ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6364488794010925785 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9732024-12-12T22:33:08.535ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50148
9742024-12-12T22:33:08.535ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50148 req_id = 5bc092e0-06d5-435a-993b-9aa6ba18b8d3 response_code = 200 uri = /baseboard
9752024-12-12T22:33:08.990ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9762024-12-12T22:33:08.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55439
9772024-12-12T22:33:09.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20616 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55439 req_id = 1860125d-29a5-4404-9934-7e7b2cc280d7 response_code = 200 uri = /timesync
9782024-12-12T22:33:09.011ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-12T22:32:07.979018238Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 12860365929060177652 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9792024-12-12T22:33:09.013ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-12T22:32:07.978473567Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1942627166372905777 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9802024-12-12T22:33:09.013ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-12T22:32:26.668261159Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1120312021778769365 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9812024-12-12T22:33:09.013ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-12T22:32:33.188066207Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3310330337306242593 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9822024-12-12T22:33:09.014ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-12T22:32:33.188445359Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13684154738373954329 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9832024-12-12T22:33:09.014ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-12T22:32:26.117870324Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4328111800993955750 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9842024-12-12T22:33:09.014ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-12T22:32:26.226555993Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1144492746958027542 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
9852024-12-12T22:33:09.016ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 395716987, ip_addr: 23.150.41.123, stratum: 5, ref_time: 1734042786.1066818, correction: 0.034223568 } file = sled-agent/src/rack_setup/service.rs:743
9862024-12-12T22:33:09.016ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
9872024-12-12T22:33:09.045ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 274d5912-4a70-4fa9-bda4-a3ea3c10fa1d (service), filesystem_pool: Some(ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: c29982ca-1c1c-420b-ace3-c75702fa0579 (service), filesystem_pool: Some(ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 7160cbb3-b56f-4e07-9380-65c1eba185bc (service), filesystem_pool: Some(ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ef370558-79d6-4859-a992-05984241db89 (service), filesystem_pool: Some(ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 5e32d2e4-482f-4c9b-9df6-ae9289017180, kind: Service { id: ef370558-79d6-4859-a992-05984241db89 }, name: Name("ntp-ef370558-79d6-4859-a992-05984241db89"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 142])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 481c4887-5a47-468e-9af8-84509ebf19dc (service), filesystem_pool: Some(ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 426428fa-8021-44ee-a5a3-8cb030e671fb (service), filesystem_pool: Some(ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External } } } }, OmicronZoneConfig { id: c5730fcb-4ef2-4818-aaaa-590f5637ea25 (service), filesystem_pool: Some(ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4 (service), filesystem_pool: Some(ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External } } } }, OmicronZoneConfig { id: 73b58170-dd1e-454a-af96-3711a45e3974 (service), filesystem_pool: Some(ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9882024-12-12T22:33:09.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34547
9892024-12-12T22:33:09.046ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 274d5912-4a70-4fa9-bda4-a3ea3c10fa1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
9902024-12-12T22:33:09.046ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 274d5912-4a70-4fa9-bda4-a3ea3c10fa1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9912024-12-12T22:33:09.084ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c29982ca-1c1c-420b-ace3-c75702fa0579, dataset_name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
9922024-12-12T22:33:09.084ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c29982ca-1c1c-420b-ace3-c75702fa0579, dataset_name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9932024-12-12T22:33:09.121ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7160cbb3-b56f-4e07-9380-65c1eba185bc, dataset_name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
9942024-12-12T22:33:09.121ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7160cbb3-b56f-4e07-9380-65c1eba185bc, dataset_name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9952024-12-12T22:33:09.158ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 481c4887-5a47-468e-9af8-84509ebf19dc, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9962024-12-12T22:33:09.158ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 481c4887-5a47-468e-9af8-84509ebf19dc, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9972024-12-12T22:33:09.195ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 426428fa-8021-44ee-a5a3-8cb030e671fb, dataset_name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9982024-12-12T22:33:09.195ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 426428fa-8021-44ee-a5a3-8cb030e671fb, dataset_name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9992024-12-12T22:33:09.232ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c5730fcb-4ef2-4818-aaaa-590f5637ea25, dataset_name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10002024-12-12T22:33:09.232ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c5730fcb-4ef2-4818-aaaa-590f5637ea25, dataset_name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10012024-12-12T22:33:09.267ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4, dataset_name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10022024-12-12T22:33:09.267ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4, dataset_name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: Cockroach }, responder: ... }
10032024-12-12T22:33:09.305ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 73b58170-dd1e-454a-af96-3711a45e3974, dataset_name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10042024-12-12T22:33:09.305ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 73b58170-dd1e-454a-af96-3711a45e3974, dataset_name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10052024-12-12T22:33:09.342ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10062024-12-12T22:33:09.342ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/omicron-zones.json file = common/src/ledger.rs:177
10072024-12-12T22:33:09.342ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/omicron-zones.json file = common/src/ledger.rs:177
10082024-12-12T22:33:09.342ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10092024-12-12T22:33:09.426ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10102024-12-12T22:33:09.426ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10112024-12-12T22:33:09.426ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10122024-12-12T22:33:09.426ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10132024-12-12T22:33:09.426ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10142024-12-12T22:33:09.520ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25 file = illumos-utils/src/zone.rs:325
10152024-12-12T22:33:09.524ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb file = illumos-utils/src/zone.rs:325
10162024-12-12T22:33:09.528ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc file = illumos-utils/src/zone.rs:325
10172024-12-12T22:33:09.533ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4 file = illumos-utils/src/zone.rs:325
10182024-12-12T22:33:09.537ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974 file = illumos-utils/src/zone.rs:325
10192024-12-12T22:33:09.542ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25 file = illumos-utils/src/zone.rs:363
10202024-12-12T22:33:09.546ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb file = illumos-utils/src/zone.rs:363
10212024-12-12T22:33:09.551ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc file = illumos-utils/src/zone.rs:363
10222024-12-12T22:33:09.556ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4 file = illumos-utils/src/zone.rs:363
10232024-12-12T22:33:09.560ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974 file = illumos-utils/src/zone.rs:363
10242024-12-12T22:33:12.458ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='481c4887-5a47-468e-9af8-84509ebf19dc'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10252024-12-12T22:33:12.459ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc
10262024-12-12T22:33:12.495ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='73b58170-dd1e-454a-af96-3711a45e3974'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10272024-12-12T22:33:12.495ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974
10282024-12-12T22:33:12.522ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c5730fcb-4ef2-4818-aaaa-590f5637ea25'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10292024-12-12T22:33:12.522ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25
10302024-12-12T22:33:12.528ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='426428fa-8021-44ee-a5a3-8cb030e671fb'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10312024-12-12T22:33:12.528ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb
10322024-12-12T22:33:12.580ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10332024-12-12T22:33:12.580ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4
10342024-12-12T22:33:12.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc") failed: Property not found. retry in 64.303362ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc
10352024-12-12T22:33:12.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974") failed: Property not found. retry in 63.832028ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974
10362024-12-12T22:33:12.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25") failed: Property not found. retry in 56.634232ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25
10372024-12-12T22:33:12.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb") failed: Property not found. retry in 72.414396ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb
10382024-12-12T22:33:12.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc") failed: Property not found. retry in 115.469964ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc
10392024-12-12T22:33:13.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25") failed: Property not found. retry in 90.601841ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25
10402024-12-12T22:33:13.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb") failed: Property not found. retry in 128.491631ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb
10412024-12-12T22:33:13.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc") failed: Property not found. retry in 123.845316ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc
10422024-12-12T22:33:14.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4") failed: Property not found. retry in 41.444543ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4
10432024-12-12T22:33:14.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974") failed: Property not found. retry in 143.86943ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974
10442024-12-12T22:33:15.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25") failed: Property not found. retry in 206.084372ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25
10452024-12-12T22:33:15.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb") failed: Property not found. retry in 209.500521ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb
10462024-12-12T22:33:15.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc") failed: Property not found. retry in 569.151677ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc
10472024-12-12T22:33:15.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4") failed: Property not found. retry in 74.115261ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4
10482024-12-12T22:33:15.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974") failed: Property not found. retry in 179.942533ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974
10492024-12-12T22:33:15.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25") failed: Property not found. retry in 493.835301ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25
10502024-12-12T22:33:15.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4") failed: Property not found. retry in 261.1422ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4
10512024-12-12T22:33:15.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb") failed: Property not found. retry in 428.411149ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb
10522024-12-12T22:33:15.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974") failed: Property not found. retry in 293.928771ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974
10532024-12-12T22:33:15.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4") failed: Property not found. retry in 328.035612ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4
10542024-12-12T22:33:15.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc") failed: Property not found. retry in 1.063214282s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc
10552024-12-12T22:33:15.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb") failed: Property not found. retry in 581.701266ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb
10562024-12-12T22:33:15.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974") failed: Property not found. retry in 933.515448ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974
10572024-12-12T22:33:15.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25") failed: Property not found. retry in 692.979663ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25
10582024-12-12T22:33:15.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4") failed: Property not found. retry in 535.274152ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4
10592024-12-12T22:33:16.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb") failed: Property not found. retry in 670.794833ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb
10602024-12-12T22:33:16.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4") failed: Property not found. retry in 922.119541ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4
10612024-12-12T22:33:16.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25") failed: Property not found. retry in 1.408373047s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25
10622024-12-12T22:33:16.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974") failed: Property not found. retry in 968.600518ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974
10632024-12-12T22:33:16.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc") failed: Property not found. retry in 1.227751328s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc
10642024-12-12T22:33:17.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb") failed: Property not found. retry in 939.033521ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb
10652024-12-12T22:33:17.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4") failed: Property not found. retry in 931.294926ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4
10662024-12-12T22:33:17.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974") failed: Property not found. retry in 964.954609ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974
10672024-12-12T22:33:17.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25") failed: Property not found. retry in 680.259379ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25
10682024-12-12T22:33:18.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb") failed: Property not found. retry in 796.965866ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb
10692024-12-12T22:33:18.058ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 9.826231074s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
10702024-12-12T22:33:18.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc") failed: Property not found. retry in 1.175606465s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc
10712024-12-12T22:33:18.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4") failed: Property not found. retry in 1.289306162s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4
10722024-12-12T22:33:18.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25") failed: Property not found. retry in 904.204279ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25
10732024-12-12T22:33:18.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974") failed: Property not found. retry in 1.444935191s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974
10742024-12-12T22:33:18.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb") failed: Property not found. retry in 1.240909672s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb
10752024-12-12T22:33:19.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc") failed: Property not found. retry in 733.120143ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc
10762024-12-12T22:33:19.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25") failed: Property not found. retry in 867.334439ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25
10772024-12-12T22:33:19.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4") failed: Property not found. retry in 1.1045812s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4
10782024-12-12T22:33:20.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc") failed: Property not found. retry in 1.499618068s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc
10792024-12-12T22:33:20.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb") failed: Property not found. retry in 1.282136161s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb
10802024-12-12T22:33:20.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974") failed: Property not found. retry in 1.496851798s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974
10812024-12-12T22:33:20.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25") failed: Property not found. retry in 1.244029994s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25
10822024-12-12T22:33:20.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4") failed: Property not found. retry in 832.66083ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4
10832024-12-12T22:33:21.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb") failed: Property not found. retry in 1.274857775s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb
10842024-12-12T22:33:21.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc") failed: Property not found. retry in 963.383701ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc
10852024-12-12T22:33:21.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4") failed: Property not found. retry in 1.105564751s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4
10862024-12-12T22:33:21.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974") failed: Property not found. retry in 1.25120748s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974
10872024-12-12T22:33:21.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25") failed: Property not found. retry in 1.208813234s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25
10882024-12-12T22:33:22.992ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_c5730fcb-4ef2-4818-aaaa-590f5637ea25
10892024-12-12T22:33:22.992ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb
10902024-12-12T22:33:22.992ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_481c4887-5a47-468e-9af8-84509ebf19dc
10912024-12-12T22:33:22.992ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4
10922024-12-12T22:33:22.992ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_73b58170-dd1e-454a-af96-3711a45e3974
10932024-12-12T22:33:22.992ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10942024-12-12T22:33:22.992ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10952024-12-12T22:33:22.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13912642 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34547 req_id = 51af6adc-2054-4cd9-a84a-2d9ad0c0257b response_code = 204 uri = /omicron-zones
10962024-12-12T22:33:23.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47798
10972024-12-12T22:33:23.059ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 31439 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47798 req_id = 6ac605be-0e3c-4fb9-b201-362ae05faa32 response_code = 500 uri = /cockroachdb
10982024-12-12T22:33:23.059ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6ac605be-0e3c-4fb9-b201-362ae05faa32", "content-length": "124", "date": "Thu, 12 Dec 2024 22:33:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6ac605be-0e3c-4fb9-b201-362ae05faa32" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 51.202372ms
10992024-12-12T22:33:23.145ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 32160 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47798 req_id = ca1fa24a-fc7d-41e9-9c66-49bb62b3f520 response_code = 500 uri = /cockroachdb
11002024-12-12T22:33:23.145ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ca1fa24a-fc7d-41e9-9c66-49bb62b3f520", "content-length": "124", "date": "Thu, 12 Dec 2024 22:33:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ca1fa24a-fc7d-41e9-9c66-49bb62b3f520" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 113.392506ms
11012024-12-12T22:33:23.287ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27671 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47798 req_id = 9c0b86ec-16ab-41ad-b057-e6e20ff02822 response_code = 500 uri = /cockroachdb
11022024-12-12T22:33:23.287ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9c0b86ec-16ab-41ad-b057-e6e20ff02822", "content-length": "124", "date": "Thu, 12 Dec 2024 22:33:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9c0b86ec-16ab-41ad-b057-e6e20ff02822" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 154.377033ms
11032024-12-12T22:33:23.469ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26081 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47798 req_id = 69aedd21-4efb-4663-bfc5-bc9cae33a9a9 response_code = 500 uri = /cockroachdb
11042024-12-12T22:33:23.470ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "69aedd21-4efb-4663-bfc5-bc9cae33a9a9", "content-length": "124", "date": "Thu, 12 Dec 2024 22:33:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "69aedd21-4efb-4663-bfc5-bc9cae33a9a9" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 158.586135ms
11052024-12-12T22:33:23.656ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26338 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47798 req_id = 210d90ff-6a67-4aa1-aed3-04e8e63b8e1c response_code = 500 uri = /cockroachdb
11062024-12-12T22:33:23.656ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "210d90ff-6a67-4aa1-aed3-04e8e63b8e1c", "content-length": "124", "date": "Thu, 12 Dec 2024 22:33:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "210d90ff-6a67-4aa1-aed3-04e8e63b8e1c" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 194.452748ms
11072024-12-12T22:33:23.881ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_426428fa-8021-44ee-a5a3-8cb030e671fb /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29631 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47798 req_id = e6e16d0b-4e27-486d-a5c9-6ae843388216 response_code = 500 uri = /cockroachdb
11082024-12-12T22:33:23.881ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e6e16d0b-4e27-486d-a5c9-6ae843388216", "content-length": "124", "date": "Thu, 12 Dec 2024 22:33:23 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e6e16d0b-4e27-486d-a5c9-6ae843388216" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 195.961521ms
11092024-12-12T22:33:24.109ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3743
11102024-12-12T22:33:36.204ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
11112024-12-12T22:33:40.474ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
11122024-12-12T22:33:40.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16400409 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47798 req_id = ad371d4d-31eb-4b75-9b16-02a375e7964a response_code = 204 uri = /cockroachdb
11132024-12-12T22:33:40.483ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49366
11142024-12-12T22:33:40.486ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1391 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49366 req_id = c19282cf-f2b5-430c-9f34-a91832e3be87 response_code = 200 uri = /baseboard
11152024-12-12T22:33:40.542ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 274d5912-4a70-4fa9-bda4-a3ea3c10fa1d (service), filesystem_pool: Some(ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: c29982ca-1c1c-420b-ace3-c75702fa0579 (service), filesystem_pool: Some(ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 7160cbb3-b56f-4e07-9380-65c1eba185bc (service), filesystem_pool: Some(ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ef370558-79d6-4859-a992-05984241db89 (service), filesystem_pool: Some(ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 5e32d2e4-482f-4c9b-9df6-ae9289017180, kind: Service { id: ef370558-79d6-4859-a992-05984241db89 }, name: Name("ntp-ef370558-79d6-4859-a992-05984241db89"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 142])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 481c4887-5a47-468e-9af8-84509ebf19dc (service), filesystem_pool: Some(ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 426428fa-8021-44ee-a5a3-8cb030e671fb (service), filesystem_pool: Some(ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External } } } }, OmicronZoneConfig { id: c5730fcb-4ef2-4818-aaaa-590f5637ea25 (service), filesystem_pool: Some(ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4 (service), filesystem_pool: Some(ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External } } } }, OmicronZoneConfig { id: 73b58170-dd1e-454a-af96-3711a45e3974 (service), filesystem_pool: Some(ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External } } } }, OmicronZoneConfig { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d (service), filesystem_pool: Some(ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a (service), filesystem_pool: Some(ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: d54db0af-3f39-4565-8dff-ec97c7805e6f (service), filesystem_pool: Some(ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: fdc353cb-29c5-4cf1-8399-519a1c345142 (service), filesystem_pool: Some(ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b (service), filesystem_pool: Some(ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 87a16640-e63a-4805-af37-109a4b725900 (service), filesystem_pool: Some(ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: ec6985ac-71a5-4de1-984b-10ae9450b19f (service), filesystem_pool: Some(ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External } } } }, OmicronZoneConfig { id: ced143a5-ba6d-4e72-b648-4813ec4f7a1c (service), filesystem_pool: Some(ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 19d9dee9-0d2e-4d66-b83d-2530780a2d3b (service), filesystem_pool: Some(ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 38288c50-ebc7-46e0-be50-6678e2ef3675 (service), filesystem_pool: Some(ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 40c621ae-aad3-4959-a02b-b6c60ed0bc3f (service), filesystem_pool: Some(ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External } } } }, OmicronZoneConfig { id: eaa29b2d-3417-484c-8cec-0158bad94bad (service), filesystem_pool: Some(ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External } } } }, OmicronZoneConfig { id: 84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d (service), filesystem_pool: Some(ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4595f35c-0789-4c4b-b046-b26e5df4bb03 (service), filesystem_pool: Some(ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External } } } }, OmicronZoneConfig { id: 47c60fb3-c89c-43b7-914d-c0be427604df (service), filesystem_pool: Some(ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3b623f90-fc4f-4177-9f01-d4b6390873db (service), filesystem_pool: Some(ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External } } } }, OmicronZoneConfig { id: ce118693-a3ed-4157-a0fa-838ac4c566aa (service), filesystem_pool: Some(ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9a5d72e7-d963-46c2-9367-3bb647d14f6c (service), filesystem_pool: Some(ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External } } } }, OmicronZoneConfig { id: 9caa2fb1-53eb-4eb5-9ec5-4827b1bab853 (service), filesystem_pool: Some(ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11162024-12-12T22:33:40.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61912
11172024-12-12T22:33:40.545ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 274d5912-4a70-4fa9-bda4-a3ea3c10fa1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11182024-12-12T22:33:40.546ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 274d5912-4a70-4fa9-bda4-a3ea3c10fa1d, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11192024-12-12T22:33:40.597ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c29982ca-1c1c-420b-ace3-c75702fa0579, dataset_name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11202024-12-12T22:33:40.597ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c29982ca-1c1c-420b-ace3-c75702fa0579, dataset_name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11212024-12-12T22:33:40.642ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7160cbb3-b56f-4e07-9380-65c1eba185bc, dataset_name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11222024-12-12T22:33:40.642ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7160cbb3-b56f-4e07-9380-65c1eba185bc, dataset_name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11232024-12-12T22:33:40.687ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 481c4887-5a47-468e-9af8-84509ebf19dc, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11242024-12-12T22:33:40.687ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 481c4887-5a47-468e-9af8-84509ebf19dc, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11252024-12-12T22:33:40.729ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 426428fa-8021-44ee-a5a3-8cb030e671fb, dataset_name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11262024-12-12T22:33:40.729ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 426428fa-8021-44ee-a5a3-8cb030e671fb, dataset_name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11272024-12-12T22:33:40.771ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c5730fcb-4ef2-4818-aaaa-590f5637ea25, dataset_name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11282024-12-12T22:33:40.771ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c5730fcb-4ef2-4818-aaaa-590f5637ea25, dataset_name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11292024-12-12T22:33:40.811ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4, dataset_name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11302024-12-12T22:33:40.811ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7fe0736a-4c6f-4a5a-99d9-31b9ed8515a4, dataset_name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: Cockroach }, responder: ... }
11312024-12-12T22:33:40.855ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 73b58170-dd1e-454a-af96-3711a45e3974, dataset_name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11322024-12-12T22:33:40.855ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 73b58170-dd1e-454a-af96-3711a45e3974, dataset_name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11332024-12-12T22:33:40.901ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11342024-12-12T22:33:40.901ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11352024-12-12T22:33:40.946ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a, dataset_name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11362024-12-12T22:33:40.947ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a, dataset_name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11372024-12-12T22:33:40.987ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ec6985ac-71a5-4de1-984b-10ae9450b19f, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
11382024-12-12T22:33:40.987ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ec6985ac-71a5-4de1-984b-10ae9450b19f, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11392024-12-12T22:33:41.027ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 40c621ae-aad3-4959-a02b-b6c60ed0bc3f, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11402024-12-12T22:33:41.027ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 40c621ae-aad3-4959-a02b-b6c60ed0bc3f, dataset_name: DatasetName { pool_name: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, kind: Crucible }, responder: ... }
11412024-12-12T22:33:41.070ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: eaa29b2d-3417-484c-8cec-0158bad94bad, dataset_name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11422024-12-12T22:33:41.070ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: eaa29b2d-3417-484c-8cec-0158bad94bad, dataset_name: DatasetName { pool_name: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, kind: Crucible }, responder: ... }
11432024-12-12T22:33:41.111ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d, dataset_name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11442024-12-12T22:33:41.111ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d, dataset_name: DatasetName { pool_name: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, kind: Crucible }, responder: ... }
11452024-12-12T22:33:41.154ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4595f35c-0789-4c4b-b046-b26e5df4bb03, dataset_name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11462024-12-12T22:33:41.154ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4595f35c-0789-4c4b-b046-b26e5df4bb03, dataset_name: DatasetName { pool_name: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, kind: Crucible }, responder: ... }
11472024-12-12T22:33:41.198ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 47c60fb3-c89c-43b7-914d-c0be427604df, dataset_name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11482024-12-12T22:33:41.198ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 47c60fb3-c89c-43b7-914d-c0be427604df, dataset_name: DatasetName { pool_name: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, kind: Crucible }, responder: ... }
11492024-12-12T22:33:41.242ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3b623f90-fc4f-4177-9f01-d4b6390873db, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11502024-12-12T22:33:41.242ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3b623f90-fc4f-4177-9f01-d4b6390873db, dataset_name: DatasetName { pool_name: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, kind: Crucible }, responder: ... }
11512024-12-12T22:33:41.284ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ce118693-a3ed-4157-a0fa-838ac4c566aa, dataset_name: DatasetName { pool_name: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11522024-12-12T22:33:41.284ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ce118693-a3ed-4157-a0fa-838ac4c566aa, dataset_name: DatasetName { pool_name: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, kind: Crucible }, responder: ... }
11532024-12-12T22:33:41.331ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9a5d72e7-d963-46c2-9367-3bb647d14f6c, dataset_name: DatasetName { pool_name: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11542024-12-12T22:33:41.331ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 9a5d72e7-d963-46c2-9367-3bb647d14f6c, dataset_name: DatasetName { pool_name: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, kind: Crucible }, responder: ... }
11552024-12-12T22:33:41.372ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9caa2fb1-53eb-4eb5-9ec5-4827b1bab853, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11562024-12-12T22:33:41.372ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 9caa2fb1-53eb-4eb5-9ec5-4827b1bab853, dataset_name: DatasetName { pool_name: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }, kind: Crucible }, responder: ... }
11572024-12-12T22:33:41.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11582024-12-12T22:33:41.421ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/omicron-zones.json file = common/src/ledger.rs:177
11592024-12-12T22:33:41.421ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/omicron-zones.json file = common/src/ledger.rs:177
11602024-12-12T22:33:41.422ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11612024-12-12T22:33:41.531ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11622024-12-12T22:33:41.570ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11632024-12-12T22:33:41.570ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11642024-12-12T22:33:41.570ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11652024-12-12T22:33:41.600ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11662024-12-12T22:33:41.600ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11672024-12-12T22:33:41.600ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11682024-12-12T22:33:41.600ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11692024-12-12T22:33:41.600ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11702024-12-12T22:33:41.600ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11712024-12-12T22:33:41.602ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11722024-12-12T22:33:41.770ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11732024-12-12T22:33:41.770ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11742024-12-12T22:33:41.833ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11752024-12-12T22:33:41.833ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11762024-12-12T22:33:41.833ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11772024-12-12T22:33:41.833ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11782024-12-12T22:33:41.833ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11792024-12-12T22:33:41.833ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11802024-12-12T22:33:41.834ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f file = illumos-utils/src/zone.rs:325
11812024-12-12T22:33:41.839ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa file = illumos-utils/src/zone.rs:325
11822024-12-12T22:33:41.845ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675 file = illumos-utils/src/zone.rs:325
11832024-12-12T22:33:41.850ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c file = illumos-utils/src/zone.rs:325
11842024-12-12T22:33:41.855ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900 file = illumos-utils/src/zone.rs:325
11852024-12-12T22:33:41.860ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad file = illumos-utils/src/zone.rs:325
11862024-12-12T22:33:41.865ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d file = illumos-utils/src/zone.rs:325
11872024-12-12T22:33:42.013ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f file = illumos-utils/src/zone.rs:363
11882024-12-12T22:33:42.018ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa file = illumos-utils/src/zone.rs:363
11892024-12-12T22:33:42.023ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675 file = illumos-utils/src/zone.rs:363
11902024-12-12T22:33:42.028ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c file = illumos-utils/src/zone.rs:363
11912024-12-12T22:33:42.032ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900 file = illumos-utils/src/zone.rs:363
11922024-12-12T22:33:42.036ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad file = illumos-utils/src/zone.rs:363
11932024-12-12T22:33:42.041ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d file = illumos-utils/src/zone.rs:363
11942024-12-12T22:33:42.046ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df file = illumos-utils/src/zone.rs:325
11952024-12-12T22:33:42.051ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03 file = illumos-utils/src/zone.rs:325
11962024-12-12T22:33:42.057ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c file = illumos-utils/src/zone.rs:325
11972024-12-12T22:33:42.062ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853 file = illumos-utils/src/zone.rs:325
11982024-12-12T22:33:42.067ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f file = illumos-utils/src/zone.rs:325
11992024-12-12T22:33:42.072ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db file = illumos-utils/src/zone.rs:325
12002024-12-12T22:33:42.078ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b file = illumos-utils/src/zone.rs:325
12012024-12-12T22:33:42.134ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12022024-12-12T22:33:42.135ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df file = illumos-utils/src/zone.rs:363
12032024-12-12T22:33:42.154ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03 file = illumos-utils/src/zone.rs:363
12042024-12-12T22:33:42.169ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c file = illumos-utils/src/zone.rs:363
12052024-12-12T22:33:42.181ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853 file = illumos-utils/src/zone.rs:363
12062024-12-12T22:33:42.189ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f file = illumos-utils/src/zone.rs:363
12072024-12-12T22:33:42.197ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db file = illumos-utils/src/zone.rs:363
12082024-12-12T22:33:42.208ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b file = illumos-utils/src/zone.rs:363
12092024-12-12T22:33:42.266ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12102024-12-12T22:33:42.327ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12112024-12-12T22:33:42.393ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12122024-12-12T22:33:42.455ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12132024-12-12T22:33:42.458ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12142024-12-12T22:33:42.458ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12152024-12-12T22:33:42.528ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 233, 96]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12162024-12-12T22:33:42.528ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12172024-12-12T22:33:42.530ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12182024-12-12T22:33:42.530ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12192024-12-12T22:33:42.643ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 145, 178]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12202024-12-12T22:33:42.643ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
12212024-12-12T22:33:42.646ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12222024-12-12T22:33:42.646ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12232024-12-12T22:33:42.763ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 164, 173]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12242024-12-12T22:33:42.763ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12252024-12-12T22:33:42.766ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12262024-12-12T22:33:42.766ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12272024-12-12T22:33:42.825ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 142, 83]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12282024-12-12T22:33:42.825ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12292024-12-12T22:33:42.828ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12302024-12-12T22:33:42.828ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12312024-12-12T22:33:42.891ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 151, 170]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12322024-12-12T22:33:42.891ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
12332024-12-12T22:33:42.892ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
12342024-12-12T22:33:42.892ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12352024-12-12T22:33:42.892ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
12362024-12-12T22:33:42.892ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
12372024-12-12T22:33:42.892ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
12382024-12-12T22:33:42.892ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
12392024-12-12T22:33:42.892ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
12402024-12-12T22:33:42.892ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
12412024-12-12T22:33:42.896ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
12422024-12-12T22:33:42.896ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
12432024-12-12T22:33:42.932ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12442024-12-12T22:33:42.934ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12452024-12-12T22:33:42.934ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12462024-12-12T22:33:42.936ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12472024-12-12T22:33:42.938ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
12482024-12-12T22:33:42.938ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12492024-12-12T22:33:42.938ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12502024-12-12T22:33:42.940ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12512024-12-12T22:33:42.943ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12522024-12-12T22:33:42.943ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12532024-12-12T22:33:43.176ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a file = illumos-utils/src/zone.rs:325
12542024-12-12T22:33:43.189ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b file = illumos-utils/src/zone.rs:325
12552024-12-12T22:33:43.199ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d file = illumos-utils/src/zone.rs:325
12562024-12-12T22:33:43.209ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142 file = illumos-utils/src/zone.rs:325
12572024-12-12T22:33:43.226ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f file = illumos-utils/src/zone.rs:325
12582024-12-12T22:33:43.238ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a file = illumos-utils/src/zone.rs:363
12592024-12-12T22:33:43.253ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b file = illumos-utils/src/zone.rs:363
12602024-12-12T22:33:43.264ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d file = illumos-utils/src/zone.rs:363
12612024-12-12T22:33:43.276ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142 file = illumos-utils/src/zone.rs:363
12622024-12-12T22:33:43.288ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f file = illumos-utils/src/zone.rs:363
12632024-12-12T22:33:51.994ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12642024-12-12T22:33:52.000ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
12652024-12-12T22:33:52.225ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3c596d62-0729-49f7-ab54-437e3babc937/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b7faea44-cb52-4678-8069-27fa8735ea6e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12662024-12-12T22:33:52.225ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ffe707ac-7f49-497d-beef-33098ae2bcc4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='762031b4-a0f4-463f-a06e-0d0ee4296156'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12672024-12-12T22:33:52.225ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1fe7b209-b868-4706-931e-d8c1958f338a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12682024-12-12T22:33:52.226ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_06e7bad6-773d-4089-9ade-6e4f457beccc/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='39edc5a4-d1b4-463c-8122-ae60a9335ca5'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12692024-12-12T22:33:52.226ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0101354b-4aed-4a3c-aa42-78e2e2510c9b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='de368254-716e-4505-a37e-b58cb7f9fcf9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12702024-12-12T22:33:52.226ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8ec50946-b029-4583-84f3-35d2ce5b9dff/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4f35bdb5-942c-42ff-9789-70dbca37cd02'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12712024-12-12T22:33:52.226ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
12722024-12-12T22:33:52.233ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
12732024-12-12T22:33:52.240ZINFOSledAgent (ServiceManager): Booting oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
12742024-12-12T22:33:52.245ZINFOSledAgent (ServiceManager): Booting oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
12752024-12-12T22:33:52.250ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
12762024-12-12T22:33:52.255ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
12772024-12-12T22:33:52.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 28.18196ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
12782024-12-12T22:33:52.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 135.07438ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
12792024-12-12T22:33:52.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 60.096127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
12802024-12-12T22:33:52.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 38.271566ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
12812024-12-12T22:33:52.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 65.838412ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
12822024-12-12T22:33:52.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 34.651955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
12832024-12-12T22:33:52.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 37.425686ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
12842024-12-12T22:33:52.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 32.263554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
12852024-12-12T22:33:52.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 104.751435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
12862024-12-12T22:33:52.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 71.031516ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
12872024-12-12T22:33:52.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 55.818734ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
12882024-12-12T22:33:52.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 114.355505ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
12892024-12-12T22:33:52.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 102.648112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
12902024-12-12T22:33:52.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 113.84811ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
12912024-12-12T22:33:52.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 112.569476ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
12922024-12-12T22:33:52.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 172.704389ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
12932024-12-12T22:33:52.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 235.500461ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
12942024-12-12T22:33:52.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 164.04384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
12952024-12-12T22:33:52.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 210.939407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
12962024-12-12T22:33:52.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 235.348697ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
12972024-12-12T22:33:52.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 143.930338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
12982024-12-12T22:33:52.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 578.538887ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
12992024-12-12T22:33:52.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 279.031458ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
13002024-12-12T22:33:52.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 503.3453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
13012024-12-12T22:33:52.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 385.041136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
13022024-12-12T22:33:52.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 236.963654ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
13032024-12-12T22:33:52.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 348.577594ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
13042024-12-12T22:33:52.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 533.811407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
13052024-12-12T22:33:53.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 514.220738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
13062024-12-12T22:33:53.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 440.149407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
13072024-12-12T22:33:53.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 590.06448ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
13082024-12-12T22:33:53.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 727.409074ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
13092024-12-12T22:33:53.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 457.355961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
13102024-12-12T22:33:53.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 946.421778ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
13112024-12-12T22:33:53.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 746.369763ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
13122024-12-12T22:33:53.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 1.365984762s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
13132024-12-12T22:33:53.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 720.934339ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
13142024-12-12T22:33:53.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 554.078759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
13152024-12-12T22:33:53.767ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13162024-12-12T22:33:53.772ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13172024-12-12T22:33:53.772ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13182024-12-12T22:33:53.772ZINFOSledAgent (ServiceManager): Booting oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
13192024-12-12T22:33:53.779ZINFOSledAgent (ServiceManager): Booting oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
13202024-12-12T22:33:53.785ZINFOSledAgent (ServiceManager): Booting oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
13212024-12-12T22:33:53.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 1.360048298s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
13222024-12-12T22:33:54.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 698.500174ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
13232024-12-12T22:33:54.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 54.969062ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
13242024-12-12T22:33:54.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 45.501862ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
13252024-12-12T22:33:54.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 66.133035ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
13262024-12-12T22:33:54.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 1.00318443s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
13272024-12-12T22:33:54.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 533.580732ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
13282024-12-12T22:33:54.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 753.609717ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
13292024-12-12T22:33:54.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 89.694994ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
13302024-12-12T22:33:54.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 641.548502ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
13312024-12-12T22:33:54.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 147.205311ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
13322024-12-12T22:33:54.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 127.598372ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
13332024-12-12T22:33:54.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 295.057848ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
13342024-12-12T22:33:54.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 689.995873ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
13352024-12-12T22:33:54.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 141.709867ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
13362024-12-12T22:33:54.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 282.505146ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
13372024-12-12T22:33:54.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 1.207944545s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
13382024-12-12T22:33:55.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 312.17408ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
13392024-12-12T22:33:55.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 494.505053ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
13402024-12-12T22:33:55.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 977.462001ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
13412024-12-12T22:33:55.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 342.742058ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
13422024-12-12T22:33:55.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 1.046379246s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
13432024-12-12T22:33:55.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 1.041595544s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
13442024-12-12T22:33:55.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 429.804858ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
13452024-12-12T22:33:55.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 845.308725ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
13462024-12-12T22:33:55.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 1.054670594s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
13472024-12-12T22:33:55.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 556.108405ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
13482024-12-12T22:33:55.548ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 16.724053323s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
13492024-12-12T22:33:55.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 753.037085ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
13502024-12-12T22:33:55.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 1.492183708s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
13512024-12-12T22:33:55.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 622.699938ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
13522024-12-12T22:33:56.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 1.376886364s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
13532024-12-12T22:33:56.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 1.263112465s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
13542024-12-12T22:33:56.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 1.117344111s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
13552024-12-12T22:33:56.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 1.0406144s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
13562024-12-12T22:33:56.251ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13572024-12-12T22:33:56.275ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13582024-12-12T22:33:56.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 986.229518ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
13592024-12-12T22:33:56.285ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
13602024-12-12T22:33:56.290ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
13612024-12-12T22:33:56.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 609.78294ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
13622024-12-12T22:33:56.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 888.573257ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
13632024-12-12T22:33:56.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 52.996142ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
13642024-12-12T22:33:56.529ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7f06226e-11ea-486e-af15-8d699acd01e2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13652024-12-12T22:33:56.529ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_662d717a-a0c0-4538-854a-f7813f739fb9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='07589197-6282-451c-a1c7-b38130717a37'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13662024-12-12T22:33:56.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 995.804015ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
13672024-12-12T22:33:56.575ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='34dbff20-9e71-4ac3-8fd1-0f002de3c0e4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13682024-12-12T22:33:56.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 1.174619709s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
13692024-12-12T22:33:56.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 83.117226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
13702024-12-12T22:33:56.598ZINFOSledAgent (ServiceManager): Booting oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
13712024-12-12T22:33:56.604ZINFOSledAgent (ServiceManager): Booting oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
13722024-12-12T22:33:56.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 37.081975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
13732024-12-12T22:33:56.619ZINFOSledAgent (ServiceManager): Booting oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
13742024-12-12T22:33:56.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 179.449302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
13752024-12-12T22:33:56.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 145.65727ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
13762024-12-12T22:33:56.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 48.370637ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
13772024-12-12T22:33:56.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 189.311007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
13782024-12-12T22:33:56.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 74.558968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
13792024-12-12T22:33:56.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 541.75796ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
13802024-12-12T22:33:56.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 133.688347ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
13812024-12-12T22:33:56.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 30.331415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
13822024-12-12T22:33:56.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 1.214320164s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
13832024-12-12T22:33:56.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 122.581028ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
13842024-12-12T22:33:56.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 135.922894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
13852024-12-12T22:33:57.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 276.921045ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
13862024-12-12T22:33:57.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 464.771502ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
13872024-12-12T22:33:57.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 1.231048746s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
13882024-12-12T22:33:57.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 216.158443ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
13892024-12-12T22:33:57.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 299.202813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
13902024-12-12T22:33:57.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 752.817248ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
13912024-12-12T22:33:57.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 604.337637ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
13922024-12-12T22:33:57.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 687.538426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
13932024-12-12T22:33:57.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 784.538878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
13942024-12-12T22:33:57.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 376.671455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
13952024-12-12T22:33:57.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 566.103488ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
13962024-12-12T22:33:57.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 1.416529876s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
13972024-12-12T22:33:57.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 1.153961306s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
13982024-12-12T22:33:57.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 502.832519ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
13992024-12-12T22:33:57.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 692.429049ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
14002024-12-12T22:33:57.522ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14012024-12-12T22:33:57.522ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14022024-12-12T22:33:57.523ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
14032024-12-12T22:33:57.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 910.570186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
14042024-12-12T22:33:57.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 701.107475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
14052024-12-12T22:33:57.760ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
14062024-12-12T22:33:57.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 873.527632ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
14072024-12-12T22:33:57.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 560.100745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
14082024-12-12T22:33:57.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 561.056026ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
14092024-12-12T22:33:57.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 622.86593ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
14102024-12-12T22:33:57.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 752.029927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
14112024-12-12T22:33:57.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 44.079226ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
14122024-12-12T22:33:58.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 57.99378ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
14132024-12-12T22:33:58.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 557.151266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
14142024-12-12T22:33:58.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 1.274751284s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
14152024-12-12T22:33:58.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 70.167453ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
14162024-12-12T22:33:58.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 76.686965ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
14172024-12-12T22:33:58.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 1.338163797s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
14182024-12-12T22:33:58.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 252.301004ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
14192024-12-12T22:33:58.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 207.480702ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
14202024-12-12T22:33:58.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 545.370099ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
14212024-12-12T22:33:58.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 713.238327ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
14222024-12-12T22:33:58.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 1.001158902s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
14232024-12-12T22:33:58.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 1.453941953s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
14242024-12-12T22:33:58.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 398.972125ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
14252024-12-12T22:33:58.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 295.989213ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
14262024-12-12T22:33:58.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 1.48195925s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
14272024-12-12T22:33:58.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 1.06457249s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
14282024-12-12T22:33:58.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 1.106477304s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
14292024-12-12T22:33:58.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 763.904315ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
14302024-12-12T22:33:58.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 1.343434882s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
14312024-12-12T22:33:58.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 1.319932468s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
14322024-12-12T22:33:58.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 518.694915ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
14332024-12-12T22:33:58.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 965.543808ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
14342024-12-12T22:33:58.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 1.470349726s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
14352024-12-12T22:33:58.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 621.511251ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
14362024-12-12T22:33:58.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 1.111446142s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
14372024-12-12T22:33:58.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 1.446233361s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
14382024-12-12T22:33:58.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 1.101916643s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
14392024-12-12T22:33:59.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 1.336502647s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
14402024-12-12T22:33:59.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 1.049699249s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
14412024-12-12T22:33:59.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 1.169351485s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
14422024-12-12T22:33:59.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 575.917437ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
14432024-12-12T22:33:59.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 1.178738259s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
14442024-12-12T22:33:59.422ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='87a16640-e63a-4805-af37-109a4b725900'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14452024-12-12T22:33:59.422ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
14462024-12-12T22:33:59.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 1.355919293s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
14472024-12-12T22:33:59.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 528.602657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
14482024-12-12T22:33:59.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 862.569156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
14492024-12-12T22:33:59.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 828.904223ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
14502024-12-12T22:33:59.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 30.09196ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
14512024-12-12T22:33:59.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 1.085783847s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
14522024-12-12T22:33:59.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 74.384875ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
14532024-12-12T22:33:59.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 1.01570032s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
14542024-12-12T22:33:59.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 548.063589ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
14552024-12-12T22:33:59.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 246.165455ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
14562024-12-12T22:33:59.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 569.331369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
14572024-12-12T22:33:59.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 1.238605884s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
14582024-12-12T22:33:59.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 1.184936118s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
14592024-12-12T22:34:00.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 1.046972401s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
14602024-12-12T22:34:00.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 1.292885841s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
14612024-12-12T22:34:00.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 294.582894ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
14622024-12-12T22:34:00.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 1.161381855s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
14632024-12-12T22:34:00.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 1.399837811s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
14642024-12-12T22:34:00.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 608.078714ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
14652024-12-12T22:34:00.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 733.045826ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
14662024-12-12T22:34:00.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 749.332391ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
14672024-12-12T22:34:00.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 1.399130293s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
14682024-12-12T22:34:00.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 1.009589s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
14692024-12-12T22:34:00.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 1.137048899s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
14702024-12-12T22:34:00.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 1.26792044s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
14712024-12-12T22:34:00.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 616.640409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
14722024-12-12T22:34:00.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 580.755288ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
14732024-12-12T22:34:00.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 1.194495593s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
14742024-12-12T22:34:00.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 988.519585ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
14752024-12-12T22:34:00.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 618.027063ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
14762024-12-12T22:34:01.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 686.070728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
14772024-12-12T22:34:01.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 1.200825587s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
14782024-12-12T22:34:01.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 1.064751082s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
14792024-12-12T22:34:01.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 1.288775595s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
14802024-12-12T22:34:01.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 837.73264ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
14812024-12-12T22:34:01.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 1.245776705s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
14822024-12-12T22:34:01.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 1.338651663s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
14832024-12-12T22:34:01.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 1.163805301s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
14842024-12-12T22:34:01.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 703.951947ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
14852024-12-12T22:34:01.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 606.871346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
14862024-12-12T22:34:01.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 1.307066859s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
14872024-12-12T22:34:01.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 772.697129ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
14882024-12-12T22:34:01.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 764.479325ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
14892024-12-12T22:34:01.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 1.31707209s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
14902024-12-12T22:34:01.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 605.116461ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
14912024-12-12T22:34:01.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 723.896805ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
14922024-12-12T22:34:01.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 1.08634408s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
14932024-12-12T22:34:01.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 1.131661885s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
14942024-12-12T22:34:02.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 722.681663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
14952024-12-12T22:34:02.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 714.125406ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
14962024-12-12T22:34:02.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 660.530823ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
14972024-12-12T22:34:02.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 557.443984ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
14982024-12-12T22:34:02.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 510.491029ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
14992024-12-12T22:34:02.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 1.447625417s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
15002024-12-12T22:34:02.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 914.211488ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
15012024-12-12T22:34:02.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 879.893203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
15022024-12-12T22:34:02.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 1.314858444s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
15032024-12-12T22:34:02.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 1.422515023s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
15042024-12-12T22:34:02.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 698.799888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
15052024-12-12T22:34:02.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 832.71073ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
15062024-12-12T22:34:02.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 1.300639874s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
15072024-12-12T22:34:02.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 507.18747ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
15082024-12-12T22:34:02.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 1.242619892s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
15092024-12-12T22:34:02.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 1.259475704s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
15102024-12-12T22:34:02.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 1.275767335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
15112024-12-12T22:34:02.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 1.437548189s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
15122024-12-12T22:34:02.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 1.36305387s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
15132024-12-12T22:34:02.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 719.03549ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
15142024-12-12T22:34:03.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 710.524864ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
15152024-12-12T22:34:03.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 632.96959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
15162024-12-12T22:34:03.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 645.396645ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
15172024-12-12T22:34:03.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 876.255937ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
15182024-12-12T22:34:03.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 555.137788ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
15192024-12-12T22:34:03.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 790.287084ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
15202024-12-12T22:34:03.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 743.193745ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
15212024-12-12T22:34:03.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 515.56428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
15222024-12-12T22:34:03.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 720.739881ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
15232024-12-12T22:34:03.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 1.152078117s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
15242024-12-12T22:34:03.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 1.454577274s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
15252024-12-12T22:34:03.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 866.018604ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
15262024-12-12T22:34:03.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 1.481067397s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
15272024-12-12T22:34:03.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 734.540658ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
15282024-12-12T22:34:03.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 1.450582871s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
15292024-12-12T22:34:03.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 945.390814ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
15302024-12-12T22:34:03.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 1.107223091s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
15312024-12-12T22:34:03.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 1.47863507s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
15322024-12-12T22:34:03.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 1.067661155s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
15332024-12-12T22:34:03.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 1.113583399s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
15342024-12-12T22:34:03.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 1.407000069s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
15352024-12-12T22:34:04.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 656.215542ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
15362024-12-12T22:34:04.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 915.494535ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
15372024-12-12T22:34:04.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 1.394023197s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
15382024-12-12T22:34:04.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 1.128801839s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
15392024-12-12T22:34:04.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 1.471407064s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
15402024-12-12T22:34:04.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 698.375406ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
15412024-12-12T22:34:04.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 1.074418009s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
15422024-12-12T22:34:04.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 1.499780252s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
15432024-12-12T22:34:04.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 528.596996ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
15442024-12-12T22:34:04.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 1.081104402s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
15452024-12-12T22:34:04.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 1.410482621s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
15462024-12-12T22:34:04.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 608.416186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
15472024-12-12T22:34:04.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 635.100397ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
15482024-12-12T22:34:05.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 1.413012386s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
15492024-12-12T22:34:05.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 1.212626247s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
15502024-12-12T22:34:05.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 829.030294ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
15512024-12-12T22:34:05.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 1.486018135s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
15522024-12-12T22:34:05.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 608.064089ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
15532024-12-12T22:34:05.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 1.262361371s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
15542024-12-12T22:34:05.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 1.160421195s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
15552024-12-12T22:34:05.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 1.176907066s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
15562024-12-12T22:34:05.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 1.092504668s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
15572024-12-12T22:34:05.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 1.4583586s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
15582024-12-12T22:34:05.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 1.020745096s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
15592024-12-12T22:34:05.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 611.101574ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
15602024-12-12T22:34:05.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 995.349444ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
15612024-12-12T22:34:05.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 919.507634ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
15622024-12-12T22:34:05.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 1.00895414s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
15632024-12-12T22:34:05.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 1.036337401s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
15642024-12-12T22:34:05.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 828.406916ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
15652024-12-12T22:34:05.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 1.108610229s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
15662024-12-12T22:34:06.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 913.175512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
15672024-12-12T22:34:06.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 1.176586661s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
15682024-12-12T22:34:06.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 1.213542036s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
15692024-12-12T22:34:06.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 752.235851ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
15702024-12-12T22:34:06.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 1.421776594s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
15712024-12-12T22:34:06.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 711.550535ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
15722024-12-12T22:34:06.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 826.139938ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
15732024-12-12T22:34:06.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 1.113505589s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
15742024-12-12T22:34:06.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 882.518007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
15752024-12-12T22:34:06.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 1.134804356s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
15762024-12-12T22:34:06.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 574.886201ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
15772024-12-12T22:34:06.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 871.734958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
15782024-12-12T22:34:06.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 1.079470813s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
15792024-12-12T22:34:06.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 1.224724284s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
15802024-12-12T22:34:06.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 1.329535111s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
15812024-12-12T22:34:06.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 855.186269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
15822024-12-12T22:34:06.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 1.439821483s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
15832024-12-12T22:34:07.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 1.405688805s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
15842024-12-12T22:34:07.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 586.261387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
15852024-12-12T22:34:07.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 983.533063ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
15862024-12-12T22:34:07.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 712.184688ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
15872024-12-12T22:34:07.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 1.353085536s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
15882024-12-12T22:34:07.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 1.259444098s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
15892024-12-12T22:34:07.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 928.369083ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
15902024-12-12T22:34:07.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 863.682728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
15912024-12-12T22:34:07.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 1.081989655s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
15922024-12-12T22:34:07.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 1.080374977s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
15932024-12-12T22:34:07.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 1.189686927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
15942024-12-12T22:34:07.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 1.151806482s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
15952024-12-12T22:34:07.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 1.229896342s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
15962024-12-12T22:34:07.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 962.931747ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
15972024-12-12T22:34:07.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 1.433136073s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
15982024-12-12T22:34:07.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 1.120453007s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
15992024-12-12T22:34:07.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 1.130465576s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
16002024-12-12T22:34:07.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 898.776886ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
16012024-12-12T22:34:08.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 909.636785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
16022024-12-12T22:34:08.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 720.995412ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
16032024-12-12T22:34:08.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 1.028443601s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
16042024-12-12T22:34:08.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 1.034012742s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
16052024-12-12T22:34:08.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 1.47738773s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
16062024-12-12T22:34:08.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 1.312973021s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
16072024-12-12T22:34:08.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 1.319586541s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
16082024-12-12T22:34:08.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 1.312178745s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
16092024-12-12T22:34:08.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 634.293941ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
16102024-12-12T22:34:08.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 1.361351007s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
16112024-12-12T22:34:08.653ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16122024-12-12T22:34:08.665ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f
16132024-12-12T22:34:08.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 672.809923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
16142024-12-12T22:34:08.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 647.687177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
16152024-12-12T22:34:08.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 854.763691ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
16162024-12-12T22:34:08.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 586.202755ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
16172024-12-12T22:34:08.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 951.105839ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
16182024-12-12T22:34:08.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 1.242988415s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
16192024-12-12T22:34:08.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f") failed: Property not found. retry in 30.063803ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f
16202024-12-12T22:34:08.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f") failed: Property not found. retry in 116.906736ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f
16212024-12-12T22:34:08.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 529.601249ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
16222024-12-12T22:34:08.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 655.098014ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
16232024-12-12T22:34:09.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 954.876703ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
16242024-12-12T22:34:09.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f") failed: Property not found. retry in 268.688653ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f
16252024-12-12T22:34:09.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 834.07015ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
16262024-12-12T22:34:09.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 1.42254617s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
16272024-12-12T22:34:09.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 1.205796168s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
16282024-12-12T22:34:09.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 1.369389419s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
16292024-12-12T22:34:09.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f") failed: Property not found. retry in 539.327116ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f
16302024-12-12T22:34:09.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 690.981088ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
16312024-12-12T22:34:09.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 616.61391ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
16322024-12-12T22:34:09.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 1.439723101s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
16332024-12-12T22:34:09.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 1.474544751s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
16342024-12-12T22:34:09.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 990.871188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
16352024-12-12T22:34:09.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 1.179703275s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
16362024-12-12T22:34:09.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 1.292772482s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
16372024-12-12T22:34:09.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 1.346820782s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
16382024-12-12T22:34:09.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 1.311626971s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
16392024-12-12T22:34:09.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 1.219187462s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
16402024-12-12T22:34:09.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 1.401177366s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
16412024-12-12T22:34:09.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f") failed: Property not found. retry in 577.267478ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f
16422024-12-12T22:34:09.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 1.014128089s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
16432024-12-12T22:34:09.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 1.344499232s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
16442024-12-12T22:34:10.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 1.437476184s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
16452024-12-12T22:34:10.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 724.151976ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
16462024-12-12T22:34:10.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 870.441358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
16472024-12-12T22:34:10.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 1.473696299s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
16482024-12-12T22:34:10.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 700.784633ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
16492024-12-12T22:34:10.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f") failed: Property not found. retry in 793.374808ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f
16502024-12-12T22:34:10.561ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45923
16512024-12-12T22:34:10.589ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10017 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45923 req_id = fb31fc41-a58e-4b79-8290-7e25449325c1 response_code = 200 uri = /baseboard
16522024-12-12T22:34:10.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 1.004909596s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
16532024-12-12T22:34:10.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 739.003181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
16542024-12-12T22:34:10.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 1.154009101s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
16552024-12-12T22:34:10.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 681.25433ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
16562024-12-12T22:34:10.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 1.095213889s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
16572024-12-12T22:34:10.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 636.481324ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
16582024-12-12T22:34:10.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 1.283772862s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
16592024-12-12T22:34:11.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 1.146159909s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
16602024-12-12T22:34:11.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 515.468146ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
16612024-12-12T22:34:11.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 991.121301ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
16622024-12-12T22:34:11.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 1.077469957s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
16632024-12-12T22:34:11.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 1.393075008s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
16642024-12-12T22:34:11.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 847.039693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
16652024-12-12T22:34:11.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 826.41353ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
16662024-12-12T22:34:11.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 949.674797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
16672024-12-12T22:34:11.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 636.432533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
16682024-12-12T22:34:11.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f") failed: Property not found. retry in 1.392974814s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f
16692024-12-12T22:34:11.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 697.792389ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
16702024-12-12T22:34:11.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 1.133849525s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
16712024-12-12T22:34:11.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 555.826183ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
16722024-12-12T22:34:11.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 1.251232838s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
16732024-12-12T22:34:11.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 1.427191191s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
16742024-12-12T22:34:11.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 595.443391ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
16752024-12-12T22:34:11.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 1.069650808s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
16762024-12-12T22:34:11.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 1.332183358s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
16772024-12-12T22:34:11.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 1.247912216s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
16782024-12-12T22:34:11.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 685.163401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
16792024-12-12T22:34:12.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 1.221396344s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
16802024-12-12T22:34:12.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 622.41286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
16812024-12-12T22:34:12.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 589.988752ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
16822024-12-12T22:34:12.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 504.467005ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
16832024-12-12T22:34:12.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 635.075593ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
16842024-12-12T22:34:12.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 551.655755ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
16852024-12-12T22:34:12.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 1.33821161s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
16862024-12-12T22:34:12.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 698.223652ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
16872024-12-12T22:34:12.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 1.101996927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
16882024-12-12T22:34:12.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 1.315791333s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
16892024-12-12T22:34:12.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 626.652924ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
16902024-12-12T22:34:12.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 1.457121756s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
16912024-12-12T22:34:12.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 1.188981889s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
16922024-12-12T22:34:12.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 619.858415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
16932024-12-12T22:34:12.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 595.259295ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
16942024-12-12T22:34:12.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 897.550446ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
16952024-12-12T22:34:12.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 763.635396ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
16962024-12-12T22:34:12.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f") failed: Property not found. retry in 767.031ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f
16972024-12-12T22:34:12.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 1.053866911s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
16982024-12-12T22:34:12.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 824.989967ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
16992024-12-12T22:34:12.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 1.019501767s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
17002024-12-12T22:34:12.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 550.170012ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
17012024-12-12T22:34:13.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03") failed: Property not found. retry in 1.428089641s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
17022024-12-12T22:34:13.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 555.91519ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
17032024-12-12T22:34:13.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 669.687689ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
17042024-12-12T22:34:13.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 566.833232ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
17052024-12-12T22:34:13.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 1.347830363s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
17062024-12-12T22:34:13.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 1.365582048s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
17072024-12-12T22:34:13.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 1.126522425s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
17082024-12-12T22:34:13.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 877.769318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
17092024-12-12T22:34:13.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 1.296301735s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
17102024-12-12T22:34:13.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 1.38437375s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
17112024-12-12T22:34:13.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 709.062905ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
17122024-12-12T22:34:13.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f") failed: Property not found. retry in 533.973673ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f
17132024-12-12T22:34:13.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 1.252643126s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
17142024-12-12T22:34:13.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853") failed: Property not found. retry in 699.544173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
17152024-12-12T22:34:13.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 927.729925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
17162024-12-12T22:34:13.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 1.160523361s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
17172024-12-12T22:34:13.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675") failed: Property not found. retry in 753.363567ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
17182024-12-12T22:34:13.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 826.375108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
17192024-12-12T22:34:13.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 647.381033ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
17202024-12-12T22:34:13.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 505.779124ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
17212024-12-12T22:34:13.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 1.099615378s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
17222024-12-12T22:34:14.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 737.630511ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
17232024-12-12T22:34:14.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f") failed: Property not found. retry in 1.451447703s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f
17242024-12-12T22:34:14.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 909.809823ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
17252024-12-12T22:34:14.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c") failed: Property not found. retry in 1.428211597s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
17262024-12-12T22:34:14.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b") failed: Property not found. retry in 1.130994913s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
17272024-12-12T22:34:14.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad") failed: Property not found. retry in 1.073187031s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
17282024-12-12T22:34:14.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142") failed: Property not found. retry in 1.208215925s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
17292024-12-12T22:34:14.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df") failed: Property not found. retry in 922.41054ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
17302024-12-12T22:34:14.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db") failed: Property not found. retry in 581.551264ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
17312024-12-12T22:34:14.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f") failed: Property not found. retry in 1.230207016s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
17322024-12-12T22:34:14.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa") failed: Property not found. retry in 1.473797274s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
17332024-12-12T22:34:14.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c") failed: Property not found. retry in 1.25799015s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
17342024-12-12T22:34:14.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f") failed: Property not found. retry in 1.497979494s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
17352024-12-12T22:34:14.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a") failed: Property not found. retry in 1.267480656s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
17362024-12-12T22:34:14.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d") failed: Property not found. retry in 701.526471ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
17372024-12-12T22:34:14.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900") failed: Property not found. retry in 1.401069524s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
17382024-12-12T22:34:15.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d") failed: Property not found. retry in 791.11009ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
17392024-12-12T22:34:15.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b") failed: Property not found. retry in 823.804172ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
17402024-12-12T22:34:15.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f") failed: Property not found. retry in 549.002625ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f
17412024-12-12T22:34:16.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f") failed: Property not found. retry in 1.489033976s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f
17422024-12-12T22:34:17.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f") failed: Property not found. retry in 885.852877ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f
17432024-12-12T22:34:18.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f") failed: Property not found. retry in 858.868663ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f
17442024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_736f44c0-88a6-4603-9cb4-5b66735cd20b
17452024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_40c621ae-aad3-4959-a02b-b6c60ed0bc3f
17462024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_ce118693-a3ed-4157-a0fa-838ac4c566aa
17472024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_fccfaa8c-ea2a-4fac-967f-e43007ddb28d
17482024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_38288c50-ebc7-46e0-be50-6678e2ef3675
17492024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_ced143a5-ba6d-4e72-b648-4813ec4f7a1c
17502024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_87a16640-e63a-4805-af37-109a4b725900
17512024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_eaa29b2d-3417-484c-8cec-0158bad94bad
17522024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_84b4918a-40e1-4cf2-a5a5-e3b3b1209d0d
17532024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_fdc353cb-29c5-4cf1-8399-519a1c345142
17542024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_d54db0af-3f39-4565-8dff-ec97c7805e6f
17552024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_47c60fb3-c89c-43b7-914d-c0be427604df
17562024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_6ed7f70e-6e55-43a0-a74c-b5cd82afb24a
17572024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_4595f35c-0789-4c4b-b046-b26e5df4bb03
17582024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_9a5d72e7-d963-46c2-9367-3bb647d14f6c
17592024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_9caa2fb1-53eb-4eb5-9ec5-4827b1bab853
17602024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_ec6985ac-71a5-4de1-984b-10ae9450b19f
17612024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_3b623f90-fc4f-4177-9f01-d4b6390873db
17622024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_19d9dee9-0d2e-4d66-b83d-2530780a2d3b
17632024-12-12T22:34:19.450ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17642024-12-12T22:34:19.453ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17652024-12-12T22:34:19.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38917362 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61912 req_id = 151476d9-b769-4f57-a219-40dd082f70fc response_code = 204 uri = /omicron-zones
17662024-12-12T22:34:19.465ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
17672024-12-12T22:34:19.469ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
17682024-12-12T22:34:19.472ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:802
17692024-12-12T22:34:19.505ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
17702024-12-12T22:34:19.510ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17712024-12-12T22:34:19.607ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17722024-12-12T22:34:19.764ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17732024-12-12T22:34:19.903ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17742024-12-12T22:34:20.136ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17752024-12-12T22:34:20.260ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 57.941357226s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
17762024-12-12T22:34:20.347ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17772024-12-12T22:34:20.545ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17782024-12-12T22:34:20.962ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17792024-12-12T22:34:21.145ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17802024-12-12T22:34:21.407ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17812024-12-12T22:34:22.165ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17822024-12-12T22:34:22.924ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17832024-12-12T22:34:24.308ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3980b87d-e184-4c94-b270-2b23bc414597", "content-length": "173", "date": "Thu, 12 Dec 2024 22:34:24 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"ceaea472-35b2-490f-a91b-ab350691945c\"", request_id: "3980b87d-e184-4c94-b270-2b23bc414597" } file = sled-agent/src/rack_setup/service.rs:1078
17842024-12-12T22:34:25.581ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "107f0b37-839c-485c-aabb-af126946dd11", "content-length": "173", "date": "Thu, 12 Dec 2024 22:34:25 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"ceaea472-35b2-490f-a91b-ab350691945c\"", request_id: "107f0b37-839c-485c-aabb-af126946dd11" } file = sled-agent/src/rack_setup/service.rs:1078
17852024-12-12T22:34:27.138ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "546b293d-458e-41e9-bf9c-2c3b6f2c4c22", "content-length": "173", "date": "Thu, 12 Dec 2024 22:34:27 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"4a8c9490-d35a-4221-8585-e4103b325118\"", request_id: "546b293d-458e-41e9-bf9c-2c3b6f2c4c22" } file = sled-agent/src/rack_setup/service.rs:1078
17862024-12-12T22:34:29.664ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8e418392-3abf-48ce-a18e-6e70c2c81370", "content-length": "173", "date": "Thu, 12 Dec 2024 22:34:29 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"4a8c9490-d35a-4221-8585-e4103b325118\"", request_id: "8e418392-3abf-48ce-a18e-6e70c2c81370" } file = sled-agent/src/rack_setup/service.rs:1078
17872024-12-12T22:34:32.474ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0ceaece1-bf2a-4a63-8418-ffc76a2edfc8", "content-length": "173", "date": "Thu, 12 Dec 2024 22:34:31 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"4a8c9490-d35a-4221-8585-e4103b325118\"", request_id: "0ceaece1-bf2a-4a63-8418-ffc76a2edfc8" } file = sled-agent/src/rack_setup/service.rs:1078
17882024-12-12T22:34:35.281ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e5afc778-c858-455b-be1e-a4fe7a51a7ba", "content-length": "173", "date": "Thu, 12 Dec 2024 22:34:34 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"4a8c9490-d35a-4221-8585-e4103b325118\"", request_id: "e5afc778-c858-455b-be1e-a4fe7a51a7ba" } file = sled-agent/src/rack_setup/service.rs:1078
17892024-12-12T22:34:37.031ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
17902024-12-12T22:34:37.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45522
17912024-12-12T22:34:37.127ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17922024-12-12T22:34:37.127ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17932024-12-12T22:34:37.128ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/omicron-zones.json file = common/src/ledger.rs:177
17942024-12-12T22:34:37.133ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/omicron-zones.json file = common/src/ledger.rs:177
17952024-12-12T22:34:37.145ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17962024-12-12T22:34:37.145ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7
17972024-12-12T22:34:37.172ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17982024-12-12T22:34:37.172ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908
17992024-12-12T22:34:37.197ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18002024-12-12T22:34:37.197ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_662d717a-a0c0-4538-854a-f7813f739fb9
18012024-12-12T22:34:37.224ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18022024-12-12T22:34:37.224ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_06e7bad6-773d-4089-9ade-6e4f457beccc
18032024-12-12T22:34:37.252ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18042024-12-12T22:34:37.252ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5
18052024-12-12T22:34:37.275ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18062024-12-12T22:34:37.275ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3c596d62-0729-49f7-ab54-437e3babc937
18072024-12-12T22:34:37.296ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18082024-12-12T22:34:37.296ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ffe707ac-7f49-497d-beef-33098ae2bcc4
18092024-12-12T22:34:37.318ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18102024-12-12T22:34:37.318ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0101354b-4aed-4a3c-aa42-78e2e2510c9b
18112024-12-12T22:34:37.342ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18122024-12-12T22:34:37.342ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8ec50946-b029-4583-84f3-35d2ce5b9dff
18132024-12-12T22:34:37.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45522 req_id = 81d7b496-261c-4f6b-a770-2ce08f5d0fee response_code = 200 uri = /inventory
18142024-12-12T22:34:38.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60940
18152024-12-12T22:34:38.574ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18162024-12-12T22:34:38.575ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18172024-12-12T22:34:38.575ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18182024-12-12T22:34:38.575ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18192024-12-12T22:34:38.575ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18202024-12-12T22:34:38.575ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18212024-12-12T22:34:38.575ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18222024-12-12T22:34:38.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60940 req_id = f39fa1ef-fc72-42eb-8cc2-c528c5d2470b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18232024-12-12T22:34:38.576ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
18242024-12-12T22:34:38.581ZINFOSledAgent (RSS): Writing ledger to /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18252024-12-12T22:34:38.581ZINFOSledAgent (RSS): Writing ledger to /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18262024-12-12T22:34:38.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62676
18272024-12-12T22:34:38.629ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18282024-12-12T22:34:38.629ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18292024-12-12T22:34:38.629ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18302024-12-12T22:34:38.629ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18312024-12-12T22:34:38.629ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18322024-12-12T22:34:38.629ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18332024-12-12T22:34:38.629ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18342024-12-12T22:34:38.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62676 req_id = 810d33f5-f480-4783-b7d8-58a5d6ff6a80 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18352024-12-12T22:34:38.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57301
18362024-12-12T22:34:38.835ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18372024-12-12T22:34:38.835ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18382024-12-12T22:34:38.835ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/omicron-zones.json file = common/src/ledger.rs:177
18392024-12-12T22:34:38.838ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/omicron-zones.json file = common/src/ledger.rs:177
18402024-12-12T22:34:38.851ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18412024-12-12T22:34:38.851ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7
18422024-12-12T22:34:38.879ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18432024-12-12T22:34:38.879ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908
18442024-12-12T22:34:38.905ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18452024-12-12T22:34:38.905ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_662d717a-a0c0-4538-854a-f7813f739fb9
18462024-12-12T22:34:38.932ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18472024-12-12T22:34:38.932ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_06e7bad6-773d-4089-9ade-6e4f457beccc
18482024-12-12T22:34:38.957ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18492024-12-12T22:34:38.957ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5
18502024-12-12T22:34:38.983ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18512024-12-12T22:34:38.983ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3c596d62-0729-49f7-ab54-437e3babc937
18522024-12-12T22:34:39.009ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18532024-12-12T22:34:39.009ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ffe707ac-7f49-497d-beef-33098ae2bcc4
18542024-12-12T22:34:39.034ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18552024-12-12T22:34:39.034ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0101354b-4aed-4a3c-aa42-78e2e2510c9b
18562024-12-12T22:34:39.060ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18572024-12-12T22:34:39.060ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8ec50946-b029-4583-84f3-35d2ce5b9dff
18582024-12-12T22:34:39.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238582 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57301 req_id = 6c256326-6b00-4300-9594-9c203285401a response_code = 200 uri = /inventory
18592024-12-12T22:34:39.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35812
18602024-12-12T22:34:39.536ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18612024-12-12T22:34:39.536ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18622024-12-12T22:34:39.536ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18632024-12-12T22:34:39.536ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18642024-12-12T22:34:39.536ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18652024-12-12T22:34:39.536ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18662024-12-12T22:34:39.536ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18672024-12-12T22:34:39.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35812 req_id = 52d71ca8-c094-471f-a3b0-b85a4816723b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18682024-12-12T22:34:40.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59684
18692024-12-12T22:34:40.121ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18702024-12-12T22:34:40.121ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18712024-12-12T22:34:40.122ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18722024-12-12T22:34:40.122ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18732024-12-12T22:34:40.122ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18742024-12-12T22:34:40.122ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18752024-12-12T22:34:40.122ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18762024-12-12T22:34:40.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59684 req_id = 9a580a71-a4ec-448d-9e8d-0cac0a962913 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18772024-12-12T22:34:40.673ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45523
18782024-12-12T22:34:40.673ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45523 req_id = 39116898-2457-405a-bd7e-47d5d0905576 response_code = 200 uri = /baseboard
18792024-12-12T22:34:43.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37919
18802024-12-12T22:34:43.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 486 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37919 req_id = 05b83a5f-37b3-4608-86f1-f447d4f2a7af response_code = 200 uri = /vpc-routes
18812024-12-12T22:34:43.952ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
18822024-12-12T22:34:43.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37919 req_id = 396b2dff-56fb-4fc1-825e-bbef1b33b532 response_code = 204 uri = /eip-gateways
18832024-12-12T22:34:44.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37919 req_id = fe9d5b16-f75d-4c7b-9ab8-5ab4f4b3bd90 response_code = 204 uri = /vpc-routes
18842024-12-12T22:34:55.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55095
18852024-12-12T22:34:55.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55095 req_id = 39cf2918-a2ea-461d-981a-551743084458 response_code = 200 uri = /vpc-routes
18862024-12-12T22:34:55.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42948
18872024-12-12T22:34:55.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42948 req_id = 46647aef-d8ba-4580-9aed-236ec3502907 response_code = 200 uri = /v2p
18882024-12-12T22:34:55.475ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
18892024-12-12T22:34:55.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55095 req_id = c81d01e1-7aeb-4964-b968-22af3a8f10a5 response_code = 204 uri = /eip-gateways
18902024-12-12T22:34:55.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55095 req_id = 6c73261a-5730-49e5-92ce-674ebc1b8e89 response_code = 204 uri = /vpc-routes
18912024-12-12T22:34:55.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47211
18922024-12-12T22:34:55.541ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18932024-12-12T22:34:55.651ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18942024-12-12T22:34:55.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177695 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47211 req_id = 25550762-6f63-4b16-ba89-f2e10c245fb0 response_code = 204 uri = /switch-ports
18952024-12-12T22:34:55.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1408 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47211 req_id = e7881552-a155-46ac-aebd-5dd6e8a5ed30 response_code = 200 uri = /network-bootstore-config
18962024-12-12T22:34:55.760ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18972024-12-12T22:34:55.761ZINFOSledAgent (bootstore): Writing ledger to /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18982024-12-12T22:34:55.762ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18992024-12-12T22:34:55.763ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
19002024-12-12T22:34:55.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3507 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47211 req_id = e2eaea19-088c-4616-b94a-852c3760894b response_code = 204 uri = /network-bootstore-config
19012024-12-12T22:34:55.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59654
19022024-12-12T22:34:55.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59654 req_id = 835efd33-e04c-4093-ac86-161d6ef768fb response_code = 200 uri = /vpc-routes
19032024-12-12T22:34:56.061ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
19042024-12-12T22:34:56.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59654 req_id = 8a085cea-83d8-41ac-8e6c-5b28a439316a response_code = 204 uri = /eip-gateways
19052024-12-12T22:34:56.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59654 req_id = 00331145-6660-4baa-a2ba-a4faa4d93955 response_code = 204 uri = /vpc-routes
19062024-12-12T22:34:56.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59471
19072024-12-12T22:34:56.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59471 req_id = f97f97fe-33c9-4f30-950d-0da50403b233 response_code = 200 uri = /v2p
19082024-12-12T22:34:56.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42954
19092024-12-12T22:34:56.197ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19102024-12-12T22:34:56.236ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19112024-12-12T22:34:56.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92912 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42954 req_id = e5bef9c8-bcf6-4055-8e25-61a50d6eefbc response_code = 204 uri = /switch-ports
19122024-12-12T22:34:56.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42954 req_id = 65fdd973-8a6b-43dd-844a-150fbcc4b2fd response_code = 200 uri = /network-bootstore-config
19132024-12-12T22:34:56.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60298
19142024-12-12T22:34:56.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60298 req_id = 87f80cd5-b121-4cb2-a598-2f6a629c88ef response_code = 200 uri = /v2p
19152024-12-12T22:34:56.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52738
19162024-12-12T22:34:56.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52738 req_id = dc45b908-7e1d-4be4-9f6d-99a3d51cf75c response_code = 200 uri = /vpc-routes
19172024-12-12T22:34:56.413ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
19182024-12-12T22:34:56.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52738 req_id = 30dad801-4f68-42a4-8e94-4c8e72f23a44 response_code = 204 uri = /eip-gateways
19192024-12-12T22:34:56.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52738 req_id = a87c7607-dd4a-48a9-8fd4-37d4efc73d43 response_code = 204 uri = /vpc-routes
19202024-12-12T22:34:56.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36699
19212024-12-12T22:34:56.486ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19222024-12-12T22:34:56.520ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19232024-12-12T22:34:56.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85837 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36699 req_id = 0ed9dd43-fccf-44c8-affe-564bcc660618 response_code = 204 uri = /switch-ports
19242024-12-12T22:34:56.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36699 req_id = 21becac2-ca40-44d9-89a6-350d27d4fc33 response_code = 200 uri = /network-bootstore-config
19252024-12-12T22:35:10.706ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40745
19262024-12-12T22:35:10.706ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40745 req_id = a1cd370a-7d2b-4c7d-abc9-34930f0001f4 response_code = 200 uri = /baseboard
19272024-12-12T22:35:25.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52464
19282024-12-12T22:35:25.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52464 req_id = 1c743783-c20c-4a6e-91ae-8fe014073a9d response_code = 200 uri = /vpc-routes
19292024-12-12T22:35:25.487ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
19302024-12-12T22:35:25.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52464 req_id = b6325666-5ec5-4f8c-a71a-6cc31f52b6e0 response_code = 204 uri = /eip-gateways
19312024-12-12T22:35:25.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52464 req_id = fdd5f125-1ac7-45b6-8539-0734ca880150 response_code = 204 uri = /vpc-routes
19322024-12-12T22:35:25.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48759
19332024-12-12T22:35:25.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48759 req_id = 85b5c912-45b5-409c-a0e4-7348111c9a06 response_code = 200 uri = /v2p
19342024-12-12T22:35:25.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45606
19352024-12-12T22:35:25.787ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19362024-12-12T22:35:25.838ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19372024-12-12T22:35:25.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139997 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45606 req_id = 4eccdfa4-d946-4a80-8d3a-d43ef5b7ea98 response_code = 204 uri = /switch-ports
19382024-12-12T22:35:25.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45606 req_id = ede26586-b17c-474a-ad7c-cc876d2955f4 response_code = 200 uri = /network-bootstore-config
19392024-12-12T22:35:26.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59340
19402024-12-12T22:35:26.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59340 req_id = 01603dfe-c22d-44ef-8813-97b2acd344e9 response_code = 200 uri = /vpc-routes
19412024-12-12T22:35:26.094ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
19422024-12-12T22:35:26.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59340 req_id = f73aa395-12f2-4600-b190-3c037f44a727 response_code = 204 uri = /eip-gateways
19432024-12-12T22:35:26.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59340 req_id = ccc2a64e-617b-4843-a739-a7e9ee76eb09 response_code = 204 uri = /vpc-routes
19442024-12-12T22:35:26.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33717
19452024-12-12T22:35:26.368ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19462024-12-12T22:35:26.405ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19472024-12-12T22:35:26.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92161 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33717 req_id = 23d81dd2-dcb4-4cfb-9a1e-3b260d8a8bd7 response_code = 204 uri = /switch-ports
19482024-12-12T22:35:26.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45195
19492024-12-12T22:35:26.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33717 req_id = bc11040a-09af-4a87-ac5d-3bd507317414 response_code = 200 uri = /network-bootstore-config
19502024-12-12T22:35:26.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45195 req_id = d6a285de-3b38-48cd-b0e1-fad00873bfc8 response_code = 200 uri = /v2p
19512024-12-12T22:35:26.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33079
19522024-12-12T22:35:26.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33079 req_id = 7eda2355-f92d-4972-ab3e-8f6178709a0c response_code = 200 uri = /vpc-routes
19532024-12-12T22:35:26.528ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
19542024-12-12T22:35:26.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33079 req_id = 3d7458e9-4fe8-48bb-9cb5-41321be72c1e response_code = 204 uri = /eip-gateways
19552024-12-12T22:35:26.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33079 req_id = 39aa878c-2b1b-4dcf-bfbd-0091754f88e9 response_code = 204 uri = /vpc-routes
19562024-12-12T22:35:26.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38461
19572024-12-12T22:35:26.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38461 req_id = 7694d64c-fe2a-4cf4-a1d2-1847b898dcb7 response_code = 200 uri = /v2p
19582024-12-12T22:35:26.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64116
19592024-12-12T22:35:26.802ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19602024-12-12T22:35:26.841ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19612024-12-12T22:35:26.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96344 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64116 req_id = dd28cf16-b13e-40ae-b4cf-4ac653e302db response_code = 204 uri = /switch-ports
19622024-12-12T22:35:26.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64116 req_id = 1dd79e23-f832-4dc7-9ccf-944ab408647a response_code = 200 uri = /network-bootstore-config
19632024-12-12T22:35:40.739ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48705
19642024-12-12T22:35:40.739ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48705 req_id = 12770f0e-7cee-4106-bc32-ae6316cbe2ae response_code = 200 uri = /baseboard
19652024-12-12T22:35:55.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52879
19662024-12-12T22:35:55.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52879 req_id = 35d48c7e-f06d-49f0-b311-06b6a179e84b response_code = 200 uri = /vpc-routes
19672024-12-12T22:35:55.354ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
19682024-12-12T22:35:55.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52879 req_id = e6ebd5e1-f4b0-4dc7-9ee3-f1225be43dd7 response_code = 204 uri = /eip-gateways
19692024-12-12T22:35:55.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60553
19702024-12-12T22:35:55.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60553 req_id = 3298f62e-2478-42b9-bdb0-2aac4e59f386 response_code = 200 uri = /v2p
19712024-12-12T22:35:55.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52879 req_id = e7adb4bf-96ef-4bb7-bc0d-ec3c5ce253cf response_code = 204 uri = /vpc-routes
19722024-12-12T22:35:55.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46663
19732024-12-12T22:35:55.527ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19742024-12-12T22:35:55.565ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19752024-12-12T22:35:55.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91711 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46663 req_id = 59129d08-a5f8-4e4a-84b9-a41726e5beec response_code = 204 uri = /switch-ports
19762024-12-12T22:35:55.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46663 req_id = 9727ac3d-cc6a-49de-ad93-c9a712416eab response_code = 200 uri = /network-bootstore-config
19772024-12-12T22:35:55.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34790
19782024-12-12T22:35:55.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34790 req_id = 99b59e7f-b0c4-4931-b1bb-98af94f216d5 response_code = 200 uri = /vpc-routes
19792024-12-12T22:35:56.042ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
19802024-12-12T22:35:56.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34790 req_id = cf5cfdc6-9dc3-44cc-95ca-b5070e54d7af response_code = 204 uri = /eip-gateways
19812024-12-12T22:35:56.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39868
19822024-12-12T22:35:56.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39868 req_id = 47c0a604-397f-4865-ad96-95bf9eea89e2 response_code = 200 uri = /v2p
19832024-12-12T22:35:56.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34790 req_id = 2b6f59c3-b748-4b7a-b494-a172f9a118ab response_code = 204 uri = /vpc-routes
19842024-12-12T22:35:56.182ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53749
19852024-12-12T22:35:56.182ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19862024-12-12T22:35:56.221ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19872024-12-12T22:35:56.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92692 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53749 req_id = ca8d62fa-0641-43d1-a1a1-a2ff84ad1e77 response_code = 204 uri = /switch-ports
19882024-12-12T22:35:56.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53749 req_id = 9f7483ac-1ae7-4723-b9a8-d6cc34be6817 response_code = 200 uri = /network-bootstore-config
19892024-12-12T22:35:56.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65151
19902024-12-12T22:35:56.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65151 req_id = d77edf31-4197-4cf5-a0f4-d419766b2117 response_code = 200 uri = /vpc-routes
19912024-12-12T22:35:56.357ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
19922024-12-12T22:35:56.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65151 req_id = 7b50a1f8-a44d-44b8-b87a-e1764de308f5 response_code = 204 uri = /eip-gateways
19932024-12-12T22:35:56.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56630
19942024-12-12T22:35:56.471ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19952024-12-12T22:35:56.508ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19962024-12-12T22:35:56.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89685 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56630 req_id = 380d0d79-dfc2-4371-a221-d57c8747866a response_code = 204 uri = /switch-ports
19972024-12-12T22:35:56.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54458
19982024-12-12T22:35:56.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65151 req_id = 1aff6a16-f761-4a63-9cd2-3cfd70d85b06 response_code = 204 uri = /vpc-routes
19992024-12-12T22:35:56.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56630 req_id = 2594bcb8-dd75-4c37-94cd-32544b145aaa response_code = 200 uri = /network-bootstore-config
20002024-12-12T22:35:56.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54458 req_id = 98c26541-9e9a-48da-923d-93992127b8b6 response_code = 200 uri = /v2p
20012024-12-12T22:36:02.194ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:56260 remote_addr = [fd00:1122:3344:101::d]:38061 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
20022024-12-12T22:36:02.224ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30189 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = 4092ad26-7c12-4b78-8d3c-55faa3e50906 response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
20032024-12-12T22:36:02.411ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20042024-12-12T22:36:10.775ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33063
20052024-12-12T22:36:10.775ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33063 req_id = 429bef8e-058b-49fc-9467-9886d6dd823d response_code = 200 uri = /baseboard
20062024-12-12T22:36:25.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48696
20072024-12-12T22:36:25.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48696 req_id = 1d134866-3661-4c54-b256-729080bc0414 response_code = 200 uri = /vpc-routes
20082024-12-12T22:36:25.608ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
20092024-12-12T22:36:25.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48696 req_id = f2e632e2-e6f6-49a8-98f6-fa1f9bf7802a response_code = 204 uri = /eip-gateways
20102024-12-12T22:36:25.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48696 req_id = e8d27049-9850-4b03-8cb9-9779fa256129 response_code = 204 uri = /vpc-routes
20112024-12-12T22:36:25.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55869
20122024-12-12T22:36:25.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55869 req_id = 079f781a-4235-47a6-9f85-4454c67e1efe response_code = 200 uri = /v2p
20132024-12-12T22:36:25.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64648
20142024-12-12T22:36:25.762ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20152024-12-12T22:36:25.797ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20162024-12-12T22:36:25.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106560 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64648 req_id = b36295df-7d3c-4002-a69a-e0de7dfca505 response_code = 204 uri = /switch-ports
20172024-12-12T22:36:25.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64648 req_id = 474b3d6b-641f-44eb-afaa-e218d344c0d0 response_code = 200 uri = /network-bootstore-config
20182024-12-12T22:36:26.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54419
20192024-12-12T22:36:26.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54419 req_id = ee6f9b6a-96c6-4e57-9c23-efed4a19441e response_code = 200 uri = /vpc-routes
20202024-12-12T22:36:26.173ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
20212024-12-12T22:36:26.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54419 req_id = ace303a0-ee7b-49b6-93aa-06ceabf8200c response_code = 204 uri = /eip-gateways
20222024-12-12T22:36:26.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54419 req_id = 606cf2e5-c7eb-4168-9325-71793ac38f37 response_code = 204 uri = /vpc-routes
20232024-12-12T22:36:26.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62727
20242024-12-12T22:36:26.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62727 req_id = c517ffe0-e43c-4fff-985e-d32be754e5f8 response_code = 200 uri = /v2p
20252024-12-12T22:36:26.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45167
20262024-12-12T22:36:26.332ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20272024-12-12T22:36:26.369ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20282024-12-12T22:36:26.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101815 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45167 req_id = bf915450-3ba6-4ed9-bf49-b32e9a3382fd response_code = 204 uri = /switch-ports
20292024-12-12T22:36:26.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36402
20302024-12-12T22:36:26.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45167 req_id = 21560208-ab75-4ad8-9f59-73e83e8bb584 response_code = 200 uri = /network-bootstore-config
20312024-12-12T22:36:26.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36402 req_id = fbb216b8-50ae-4347-9452-462473250fe7 response_code = 200 uri = /vpc-routes
20322024-12-12T22:36:26.480ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
20332024-12-12T22:36:26.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36402 req_id = 5639c58d-e74c-4df2-bac6-66a41955577b response_code = 204 uri = /eip-gateways
20342024-12-12T22:36:26.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36402 req_id = 1aca3998-c8e7-4c70-9392-4fdba309d67c response_code = 204 uri = /vpc-routes
20352024-12-12T22:36:26.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60524
20362024-12-12T22:36:26.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60524 req_id = eabbe26a-ae4a-45a6-a33f-cae1afbe60ef response_code = 200 uri = /v2p
20372024-12-12T22:36:26.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57963
20382024-12-12T22:36:26.805ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20392024-12-12T22:36:26.841ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20402024-12-12T22:36:26.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90829 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57963 req_id = e6064f94-deac-4f02-9fbb-0f53a67a2069 response_code = 204 uri = /switch-ports
20412024-12-12T22:36:26.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57963 req_id = 2fadc6ff-482f-48b7-aae6-5d5907d131dd response_code = 200 uri = /network-bootstore-config
20422024-12-12T22:36:32.200ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7654 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = 0a9492f5-14ae-431f-89d3-8e990b4bb1fc response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
20432024-12-12T22:36:40.809ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45233
20442024-12-12T22:36:40.810ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45233 req_id = fed523d9-6a17-4fe5-92a9-ba2ce8d93d33 response_code = 200 uri = /baseboard
20452024-12-12T22:36:55.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56100
20462024-12-12T22:36:55.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56100 req_id = 65c71058-b533-40ab-bd67-42a8e88e7d47 response_code = 200 uri = /vpc-routes
20472024-12-12T22:36:55.375ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
20482024-12-12T22:36:55.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56100 req_id = 92cfa95b-307d-4bde-98b6-29b63d5498df response_code = 204 uri = /eip-gateways
20492024-12-12T22:36:55.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60020
20502024-12-12T22:36:55.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60020 req_id = 918d637b-6558-4b86-b497-829fede87a1b response_code = 200 uri = /v2p
20512024-12-12T22:36:55.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56100 req_id = e942fc40-0f6f-4004-a130-078964a0c0e1 response_code = 204 uri = /vpc-routes
20522024-12-12T22:36:55.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62470
20532024-12-12T22:36:55.525ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20542024-12-12T22:36:55.562ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20552024-12-12T22:36:55.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93109 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62470 req_id = d3ff212e-e12f-45eb-8f0c-555eaaa3e94e response_code = 204 uri = /switch-ports
20562024-12-12T22:36:55.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62470 req_id = b532e1b0-24c4-4ef1-91ce-511592ac43b1 response_code = 200 uri = /network-bootstore-config
20572024-12-12T22:36:55.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35860
20582024-12-12T22:36:55.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35860 req_id = 3448a3ec-af07-4227-9827-6554a85d48eb response_code = 200 uri = /vpc-routes
20592024-12-12T22:36:56.022ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
20602024-12-12T22:36:56.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35860 req_id = f3fc7c88-b717-49c8-b505-087bc3f04d5d response_code = 204 uri = /eip-gateways
20612024-12-12T22:36:56.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35860 req_id = dd17adfb-f053-43b2-9947-a337be1d9fce response_code = 204 uri = /vpc-routes
20622024-12-12T22:36:56.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50374
20632024-12-12T22:36:56.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50374 req_id = f10e9dda-383d-4d10-8342-1ad01a5b3164 response_code = 200 uri = /v2p
20642024-12-12T22:36:56.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39499
20652024-12-12T22:36:56.274ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20662024-12-12T22:36:56.315ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20672024-12-12T22:36:56.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101601 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39499 req_id = 8cfbd838-76e4-475a-8d9c-3aa938bde4e0 response_code = 204 uri = /switch-ports
20682024-12-12T22:36:56.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38924
20692024-12-12T22:36:56.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38924 req_id = 8cc50325-3704-4971-b129-796c2de11a66 response_code = 200 uri = /vpc-routes
20702024-12-12T22:36:56.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39499 req_id = 327a871b-3f43-40c7-8292-962f20078c3c response_code = 200 uri = /network-bootstore-config
20712024-12-12T22:36:56.394ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
20722024-12-12T22:36:56.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38924 req_id = e552d8fc-8747-480b-bd38-96fdf5c43a2b response_code = 204 uri = /eip-gateways
20732024-12-12T22:36:56.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38924 req_id = 1dd7cfe9-f9c7-4b40-87d9-fe1189e43bf1 response_code = 204 uri = /vpc-routes
20742024-12-12T22:36:56.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33085
20752024-12-12T22:36:56.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33085 req_id = a0d19840-2cc2-4b70-a7d5-fa2cf1c45d0a response_code = 200 uri = /v2p
20762024-12-12T22:36:56.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35529
20772024-12-12T22:36:56.505ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20782024-12-12T22:36:56.544ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20792024-12-12T22:36:56.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99119 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35529 req_id = 57729f42-0765-4edb-8aa5-bf3d98067c38 response_code = 204 uri = /switch-ports
20802024-12-12T22:36:56.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35529 req_id = 90b49e9a-dac2-4ed2-8a82-4475c7912f31 response_code = 200 uri = /network-bootstore-config
20812024-12-12T22:37:02.201ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7554 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = b31491f2-89ce-4e85-af39-011dcf8bbbc5 response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
20822024-12-12T22:37:10.844ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40330
20832024-12-12T22:37:10.845ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40330 req_id = e664bf28-75f4-45d3-ab40-3c7459b95f95 response_code = 200 uri = /baseboard
20842024-12-12T22:37:25.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53108
20852024-12-12T22:37:25.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53108 req_id = dac1c225-28a4-44df-b1c4-bc23975aeed7 response_code = 200 uri = /vpc-routes
20862024-12-12T22:37:25.661ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
20872024-12-12T22:37:25.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53108 req_id = cbd2bd30-8038-4fd6-bf78-c86024644dca response_code = 204 uri = /eip-gateways
20882024-12-12T22:37:25.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58526
20892024-12-12T22:37:25.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58526 req_id = d8a17f43-83cc-4cd8-8ec6-8f5a1fdb99c6 response_code = 200 uri = /v2p
20902024-12-12T22:37:25.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53108 req_id = 01fc179f-3fd7-42c5-8f08-68ea4b93529e response_code = 204 uri = /vpc-routes
20912024-12-12T22:37:25.712ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33125
20922024-12-12T22:37:25.712ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20932024-12-12T22:37:25.749ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20942024-12-12T22:37:25.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92727 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33125 req_id = 63940896-1a82-4d3e-bb02-22567baaf063 response_code = 204 uri = /switch-ports
20952024-12-12T22:37:25.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33125 req_id = f4387a05-0747-4d57-a060-78e81920233a response_code = 200 uri = /network-bootstore-config
20962024-12-12T22:37:26.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44300
20972024-12-12T22:37:26.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44300 req_id = dc1996c6-f37e-4d6f-8b13-5bea216015b8 response_code = 200 uri = /vpc-routes
20982024-12-12T22:37:26.292ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
20992024-12-12T22:37:26.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44300 req_id = dcb045b0-1079-44d6-b658-253c7a0fc348 response_code = 204 uri = /eip-gateways
21002024-12-12T22:37:26.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44300 req_id = 480a99a7-ec27-4dd5-b40a-f33f42a8ff47 response_code = 204 uri = /vpc-routes
21012024-12-12T22:37:26.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37072
21022024-12-12T22:37:26.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37072 req_id = da14de4b-b312-426d-a44e-1d503a9ae6e9 response_code = 200 uri = /v2p
21032024-12-12T22:37:26.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32832
21042024-12-12T22:37:26.422ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21052024-12-12T22:37:26.462ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21062024-12-12T22:37:26.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97733 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:32832 req_id = 02167d3f-2084-4502-b1e6-6bcbf078bd23 response_code = 204 uri = /switch-ports
21072024-12-12T22:37:26.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32832 req_id = 63dec12b-48c2-4e2e-8fd0-c335ef293790 response_code = 200 uri = /network-bootstore-config
21082024-12-12T22:37:26.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57812
21092024-12-12T22:37:26.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57812 req_id = 986cf593-5c48-42a3-a230-53fcc64494ad response_code = 200 uri = /vpc-routes
21102024-12-12T22:37:26.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52106
21112024-12-12T22:37:26.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52106 req_id = 87b79e88-21ca-4542-bfd6-8e7175d100ab response_code = 200 uri = /v2p
21122024-12-12T22:37:26.613ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
21132024-12-12T22:37:26.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57812 req_id = a6758365-b524-4074-8299-4e2455d1da43 response_code = 204 uri = /eip-gateways
21142024-12-12T22:37:26.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57812 req_id = 158ec3e0-2175-4d6e-8081-fbb6a9a9b36b response_code = 204 uri = /vpc-routes
21152024-12-12T22:37:26.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33732
21162024-12-12T22:37:26.697ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21172024-12-12T22:37:26.733ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21182024-12-12T22:37:26.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88777 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33732 req_id = 6323d32a-c0c5-4447-af8a-bbf503dc1772 response_code = 204 uri = /switch-ports
21192024-12-12T22:37:26.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33732 req_id = 1548f181-af47-459c-8a93-50c64db223ba response_code = 200 uri = /network-bootstore-config
21202024-12-12T22:37:32.201ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7326 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = 141f5d2a-a643-48dd-af4e-bfa21d8b151c response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
21212024-12-12T22:37:40.879ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61255
21222024-12-12T22:37:40.879ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61255 req_id = 69871228-f5f3-4142-8fc8-6aa04f09f87c response_code = 200 uri = /baseboard
21232024-12-12T22:37:55.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41296
21242024-12-12T22:37:55.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41296 req_id = 78250604-6b5e-46f1-b519-999a6bcc7f6f response_code = 200 uri = /vpc-routes
21252024-12-12T22:37:55.375ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
21262024-12-12T22:37:55.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41296 req_id = faa2beb5-3ae6-49d1-98ba-55cc0308ceef response_code = 204 uri = /eip-gateways
21272024-12-12T22:37:55.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37416
21282024-12-12T22:37:55.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37416 req_id = 1ddeb359-585a-4961-b584-e39170f192fc response_code = 200 uri = /v2p
21292024-12-12T22:37:55.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41960
21302024-12-12T22:37:55.439ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21312024-12-12T22:37:55.477ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21322024-12-12T22:37:55.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93241 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41960 req_id = c4d9089d-06a8-4456-b48f-fc5fda9f2570 response_code = 204 uri = /switch-ports
21332024-12-12T22:37:55.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41960 req_id = 745c257e-e000-4990-a900-b067059aa8f5 response_code = 200 uri = /network-bootstore-config
21342024-12-12T22:37:55.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41296 req_id = 818cc0fe-ff89-4da4-a9ab-2e74ed63ee14 response_code = 204 uri = /vpc-routes
21352024-12-12T22:37:56.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51166
21362024-12-12T22:37:56.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51166 req_id = 7a44eec4-1f8e-4bc0-934b-7bc2f9220def response_code = 200 uri = /vpc-routes
21372024-12-12T22:37:56.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43381
21382024-12-12T22:37:56.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43381 req_id = 10704480-981e-4cd9-972b-c3aeedf26998 response_code = 200 uri = /v2p
21392024-12-12T22:37:56.059ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
21402024-12-12T22:37:56.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51166 req_id = fa2f399d-09b2-4a6b-806f-40f28e22915b response_code = 204 uri = /eip-gateways
21412024-12-12T22:37:56.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51166 req_id = a29d58fb-58b2-4c80-b146-2a656802c287 response_code = 204 uri = /vpc-routes
21422024-12-12T22:37:56.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59042
21432024-12-12T22:37:56.115ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21442024-12-12T22:37:56.171ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21452024-12-12T22:37:56.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138817 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59042 req_id = 96f8881d-3874-4d1b-938a-763d6b533180 response_code = 204 uri = /switch-ports
21462024-12-12T22:37:56.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59042 req_id = 185a0cdd-8ede-4931-9157-e475521808d0 response_code = 200 uri = /network-bootstore-config
21472024-12-12T22:37:56.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52263
21482024-12-12T22:37:56.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52263 req_id = 41b05f85-daa1-4d82-a4c4-c05b52822837 response_code = 200 uri = /vpc-routes
21492024-12-12T22:37:56.461ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
21502024-12-12T22:37:56.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52263 req_id = 19dce8b8-d40f-4ceb-9c86-2b8840242ae1 response_code = 204 uri = /eip-gateways
21512024-12-12T22:37:56.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33455
21522024-12-12T22:37:56.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33455 req_id = 59012ae5-0729-4f2b-9404-510b17b57c59 response_code = 200 uri = /v2p
21532024-12-12T22:37:56.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52263 req_id = 95576312-2e01-4127-bd89-ef05f2860806 response_code = 204 uri = /vpc-routes
21542024-12-12T22:37:56.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58417
21552024-12-12T22:37:56.494ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21562024-12-12T22:37:56.530ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21572024-12-12T22:37:56.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89542 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58417 req_id = 8dc32743-ec84-40de-9e99-399e9f61b959 response_code = 204 uri = /switch-ports
21582024-12-12T22:37:56.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58417 req_id = 53980864-a4c4-49b1-bbdd-3123328a0d34 response_code = 200 uri = /network-bootstore-config
21592024-12-12T22:38:02.201ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7578 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = e0b47697-0ad1-49a5-8c61-56d4ca7774bb response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
21602024-12-12T22:38:10.913ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35306
21612024-12-12T22:38:10.913ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35306 req_id = 6ed7f2f8-f1d7-4a55-9307-7478928cb531 response_code = 200 uri = /baseboard
21622024-12-12T22:38:25.478ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55969
21632024-12-12T22:38:25.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55969 req_id = 3b6c7f8e-9fd0-4ecf-aa28-1e5aa354b300 response_code = 200 uri = /vpc-routes
21642024-12-12T22:38:25.520ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
21652024-12-12T22:38:25.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55969 req_id = 6fb8b656-6a79-4500-9858-c77cb5454d44 response_code = 204 uri = /eip-gateways
21662024-12-12T22:38:25.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42871
21672024-12-12T22:38:25.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42871 req_id = 9756421f-ceb5-411c-aa8b-40c468a94aaa response_code = 200 uri = /v2p
21682024-12-12T22:38:25.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55969 req_id = 7c1c30b3-860b-4c10-a8fe-ba7682a4b892 response_code = 204 uri = /vpc-routes
21692024-12-12T22:38:25.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34303
21702024-12-12T22:38:25.763ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21712024-12-12T22:38:25.800ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21722024-12-12T22:38:25.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115745 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34303 req_id = 8ea12a5e-cf97-4cb7-bf75-c65b3aff4e83 response_code = 204 uri = /switch-ports
21732024-12-12T22:38:25.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34303 req_id = 746c6ff7-b855-4df6-ac8a-5210e1a1ba8b response_code = 200 uri = /network-bootstore-config
21742024-12-12T22:38:26.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52484
21752024-12-12T22:38:26.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52484 req_id = 86a76f4b-1f37-4818-92f0-607a3935a42e response_code = 200 uri = /vpc-routes
21762024-12-12T22:38:26.167ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
21772024-12-12T22:38:26.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52484 req_id = 97633881-44ae-4b17-bfa1-8a5e3589da2f response_code = 204 uri = /eip-gateways
21782024-12-12T22:38:26.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53659
21792024-12-12T22:38:26.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53659 req_id = 22dd2240-88e9-4487-ac92-68a7c56275e3 response_code = 200 uri = /v2p
21802024-12-12T22:38:26.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52484 req_id = 906af773-b6c4-4e0d-8450-7de0debc6c79 response_code = 204 uri = /vpc-routes
21812024-12-12T22:38:26.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35142
21822024-12-12T22:38:26.296ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21832024-12-12T22:38:26.336ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21842024-12-12T22:38:26.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94939 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35142 req_id = 0872e3ae-8055-4ba9-ab14-833a94dc7cc1 response_code = 204 uri = /switch-ports
21852024-12-12T22:38:26.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35142 req_id = 58b0188f-4f85-4a58-82af-1aec1a2a659f response_code = 200 uri = /network-bootstore-config
21862024-12-12T22:38:26.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42130
21872024-12-12T22:38:26.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42130 req_id = fb272392-98d3-498a-b428-96abe78ec506 response_code = 200 uri = /vpc-routes
21882024-12-12T22:38:26.459ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
21892024-12-12T22:38:26.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42130 req_id = 2c56eb25-18e0-4b58-9051-0ca57ef51402 response_code = 204 uri = /eip-gateways
21902024-12-12T22:38:26.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35869
21912024-12-12T22:38:26.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35869 req_id = 31b8922d-e751-4039-a5df-079cfe3458cc response_code = 200 uri = /v2p
21922024-12-12T22:38:26.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42130 req_id = fdd6ae9f-dc82-4f2d-9de6-0244fddcc335 response_code = 204 uri = /vpc-routes
21932024-12-12T22:38:26.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37848
21942024-12-12T22:38:26.624ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21952024-12-12T22:38:26.661ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21962024-12-12T22:38:26.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96661 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37848 req_id = 0cbb4033-da12-4e3d-bef9-e577a3b5f2a2 response_code = 204 uri = /switch-ports
21972024-12-12T22:38:26.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37848 req_id = e26c4bd4-e33f-4340-bb74-c19e38c70f26 response_code = 200 uri = /network-bootstore-config
21982024-12-12T22:38:32.199ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6325 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = 6117c174-2ebe-4ba1-bc23-c8c777c77532 response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
21992024-12-12T22:38:40.947ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47428
22002024-12-12T22:38:40.947ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47428 req_id = 683cda8a-fe5b-41b0-b19c-830ac746bf93 response_code = 200 uri = /baseboard
22012024-12-12T22:38:55.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35651
22022024-12-12T22:38:55.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35651 req_id = 477799dc-896b-48ec-9765-46e402ff2dc7 response_code = 200 uri = /vpc-routes
22032024-12-12T22:38:55.346ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
22042024-12-12T22:38:55.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35651 req_id = a878f61b-a772-48ae-8d55-ee250bdd9004 response_code = 204 uri = /eip-gateways
22052024-12-12T22:38:55.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35651 req_id = 2312570a-0079-4684-97ba-c49fab994230 response_code = 204 uri = /vpc-routes
22062024-12-12T22:38:55.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38803
22072024-12-12T22:38:55.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38803 req_id = 8004eb59-ae4d-4603-8e2f-749c3056c892 response_code = 200 uri = /v2p
22082024-12-12T22:38:55.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56362
22092024-12-12T22:38:55.439ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22102024-12-12T22:38:55.476ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22112024-12-12T22:38:55.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94147 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56362 req_id = 139d9523-53c7-4913-9dcb-982bf1723a5e response_code = 204 uri = /switch-ports
22122024-12-12T22:38:55.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56362 req_id = 87beca94-c81f-490f-9f70-3b98a05323b9 response_code = 200 uri = /network-bootstore-config
22132024-12-12T22:38:56.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47529
22142024-12-12T22:38:56.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47529 req_id = 2e1e91aa-e9ad-43e1-a779-fc79bc694794 response_code = 200 uri = /v2p
22152024-12-12T22:38:56.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51018
22162024-12-12T22:38:56.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51018 req_id = 928b4f1d-0da0-45bf-860d-8bc0e0aa8acb response_code = 200 uri = /vpc-routes
22172024-12-12T22:38:56.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54288
22182024-12-12T22:38:56.168ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22192024-12-12T22:38:56.206ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22202024-12-12T22:38:56.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97969 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54288 req_id = e7d384c3-bcf4-47f5-80c7-f35d1fc09ec7 response_code = 204 uri = /switch-ports
22212024-12-12T22:38:56.266ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
22222024-12-12T22:38:56.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51018 req_id = e092bc62-f09b-4231-80b0-9b2ae2c90305 response_code = 204 uri = /eip-gateways
22232024-12-12T22:38:56.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54288 req_id = 9ff99fe1-7963-47bb-b881-29f660d7034e response_code = 200 uri = /network-bootstore-config
22242024-12-12T22:38:56.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53695
22252024-12-12T22:38:56.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53695 req_id = aab6e97c-3965-4586-af10-65806e0c81bc response_code = 200 uri = /vpc-routes
22262024-12-12T22:38:56.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51018 req_id = ccd014f1-73e4-4caa-9dc1-a88a06e20893 response_code = 204 uri = /vpc-routes
22272024-12-12T22:38:56.319ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
22282024-12-12T22:38:56.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53695 req_id = 66a02d19-aaab-4cd4-85d8-157278ad2731 response_code = 204 uri = /eip-gateways
22292024-12-12T22:38:56.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53695 req_id = 6d3b3803-0542-48ff-aa01-cba5816c8876 response_code = 204 uri = /vpc-routes
22302024-12-12T22:38:56.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56052
22312024-12-12T22:38:56.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56052 req_id = e65915e3-dec9-439c-aaba-e0592dbeb369 response_code = 200 uri = /v2p
22322024-12-12T22:38:56.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47116
22332024-12-12T22:38:56.569ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22342024-12-12T22:38:56.604ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22352024-12-12T22:38:56.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91343 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47116 req_id = 05fd3a39-7207-4a6d-8e46-8dd718bde7bc response_code = 204 uri = /switch-ports
22362024-12-12T22:38:56.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47116 req_id = 5d1f9fb3-a26b-4459-93e8-0aa8134b9c60 response_code = 200 uri = /network-bootstore-config
22372024-12-12T22:39:02.201ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7950 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = a6aface9-f9a3-4d22-8d49-6753d13bbd34 response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
22382024-12-12T22:39:10.981ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44359
22392024-12-12T22:39:10.982ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44359 req_id = b94cf85d-702a-4d3c-b57b-239f3a4712a2 response_code = 200 uri = /baseboard
22402024-12-12T22:39:25.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63424
22412024-12-12T22:39:25.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63424 req_id = edea136b-dedf-4f7e-8302-2b56984e892f response_code = 200 uri = /vpc-routes
22422024-12-12T22:39:25.428ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
22432024-12-12T22:39:25.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63424 req_id = 05f397fe-b915-4dd4-a05b-06149352d227 response_code = 204 uri = /eip-gateways
22442024-12-12T22:39:25.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54140
22452024-12-12T22:39:25.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54140 req_id = 53846e2a-8d72-4a4c-a69f-5d5419b262a9 response_code = 200 uri = /v2p
22462024-12-12T22:39:25.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63424 req_id = d68bb28d-4146-40e6-bf73-a44d832161f2 response_code = 204 uri = /vpc-routes
22472024-12-12T22:39:25.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56725
22482024-12-12T22:39:25.665ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22492024-12-12T22:39:25.701ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22502024-12-12T22:39:25.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90753 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56725 req_id = c6c5b835-d403-4c04-bae5-3ceb6d9e359f response_code = 204 uri = /switch-ports
22512024-12-12T22:39:25.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53087
22522024-12-12T22:39:25.756ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22532024-12-12T22:39:25.756ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22542024-12-12T22:39:25.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56725 req_id = 4a035a4f-8040-4b1f-8ea4-a42c3c51f344 response_code = 200 uri = /network-bootstore-config
22552024-12-12T22:39:25.756ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22562024-12-12T22:39:25.756ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22572024-12-12T22:39:25.757ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22582024-12-12T22:39:25.757ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22592024-12-12T22:39:25.757ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22602024-12-12T22:39:25.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 502 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53087 req_id = d46c2142-b867-4975-8350-b98eac300d09 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22612024-12-12T22:39:26.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53532
22622024-12-12T22:39:26.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53532 req_id = fd0178b0-af14-4dfb-8f1c-181dbcbe267b response_code = 200 uri = /vpc-routes
22632024-12-12T22:39:26.226ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
22642024-12-12T22:39:26.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53532 req_id = 5415ef7c-8e84-4b4f-8cb2-33034fc82ed1 response_code = 204 uri = /eip-gateways
22652024-12-12T22:39:26.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53532 req_id = 17ad6afc-4222-4ede-a447-cbf7d385f956 response_code = 204 uri = /vpc-routes
22662024-12-12T22:39:26.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33821
22672024-12-12T22:39:26.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33821 req_id = 3725a50a-d802-4d3c-b12b-e311c449fd74 response_code = 200 uri = /vpc-routes
22682024-12-12T22:39:26.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54054
22692024-12-12T22:39:26.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54054 req_id = 53f7e17b-499c-45d4-b5ae-87349a270b69 response_code = 200 uri = /v2p
22702024-12-12T22:39:26.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43505
22712024-12-12T22:39:26.466ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22722024-12-12T22:39:26.511ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22732024-12-12T22:39:26.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111970 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43505 req_id = 99cbeb19-cde4-449b-8a10-2c36372e37b6 response_code = 204 uri = /switch-ports
22742024-12-12T22:39:26.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39441
22752024-12-12T22:39:26.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58622
22762024-12-12T22:39:26.578ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
22772024-12-12T22:39:26.578ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22782024-12-12T22:39:26.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33821 req_id = 87f2e668-276c-4504-932a-ee4bb5d1a60c response_code = 204 uri = /eip-gateways
22792024-12-12T22:39:26.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43505 req_id = 74f4035f-14fd-4cc2-9d0e-6e97cfb94bf8 response_code = 200 uri = /network-bootstore-config
22802024-12-12T22:39:26.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58622 req_id = bf053888-64ed-4b2d-acdf-47749d7550ff response_code = 200 uri = /v2p
22812024-12-12T22:39:26.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33821 req_id = ad8d1cca-2d3b-46d6-9715-8f2a10c651a5 response_code = 204 uri = /vpc-routes
22822024-12-12T22:39:26.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48512
22832024-12-12T22:39:26.615ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22842024-12-12T22:39:26.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22852024-12-12T22:39:26.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22862024-12-12T22:39:26.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22872024-12-12T22:39:26.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22882024-12-12T22:39:26.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22892024-12-12T22:39:26.615ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22902024-12-12T22:39:26.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 389 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48512 req_id = d7dd0128-8f91-4676-a5d4-98bdbcef77e2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22912024-12-12T22:39:26.618ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22922024-12-12T22:39:26.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100869 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39441 req_id = 1432a6c6-7bd9-4796-957b-faf1cc083f15 response_code = 204 uri = /switch-ports
22932024-12-12T22:39:26.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39441 req_id = 1d7749ec-527e-4cbf-aceb-de5687096278 response_code = 200 uri = /network-bootstore-config
22942024-12-12T22:39:26.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58062
22952024-12-12T22:39:26.711ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22962024-12-12T22:39:26.711ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22972024-12-12T22:39:26.711ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22982024-12-12T22:39:26.711ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22992024-12-12T22:39:26.711ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23002024-12-12T22:39:26.711ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23012024-12-12T22:39:26.711ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23022024-12-12T22:39:26.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58062 req_id = aed03f97-134e-4681-bd1f-4c12a2cb229e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23032024-12-12T22:39:32.199ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6763 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = d401a07f-74ca-4823-a86e-e066983048c0 response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
23042024-12-12T22:39:41.015ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45982
23052024-12-12T22:39:41.015ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45982 req_id = 9a67f1f9-028d-46d2-9c31-5445dc9a7cef response_code = 200 uri = /baseboard
23062024-12-12T22:39:55.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46457
23072024-12-12T22:39:55.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46457 req_id = 8b7a4504-60b9-4c3a-9c53-2e05a8ffd9e6 response_code = 200 uri = /vpc-routes
23082024-12-12T22:39:55.286ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
23092024-12-12T22:39:55.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46457 req_id = fd065162-26bc-49df-8c43-39bb9ea6b3d4 response_code = 204 uri = /eip-gateways
23102024-12-12T22:39:55.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38500
23112024-12-12T22:39:55.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38500 req_id = ff4b0cef-1548-4890-a00b-95b29bf2e7bc response_code = 200 uri = /v2p
23122024-12-12T22:39:55.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46457 req_id = be805135-d346-4eae-9501-5844fa294279 response_code = 204 uri = /vpc-routes
23132024-12-12T22:39:55.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35985
23142024-12-12T22:39:55.630ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23152024-12-12T22:39:55.668ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23162024-12-12T22:39:55.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92801 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35985 req_id = 8392a267-9906-45b7-978b-ac373ed631e1 response_code = 204 uri = /switch-ports
23172024-12-12T22:39:55.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35985 req_id = 84f986ad-4a58-4867-9435-de74b2109365 response_code = 200 uri = /network-bootstore-config
23182024-12-12T22:39:56.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36301
23192024-12-12T22:39:56.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36301 req_id = 19e66a04-c6cc-425e-997a-4474cd459fff response_code = 200 uri = /vpc-routes
23202024-12-12T22:39:56.043ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
23212024-12-12T22:39:56.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36301 req_id = 0d376d3d-534f-4ec1-ab08-a2a3ae57d7a3 response_code = 204 uri = /eip-gateways
23222024-12-12T22:39:56.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36301 req_id = 317fd008-1c76-44ef-8689-6418693f1951 response_code = 204 uri = /vpc-routes
23232024-12-12T22:39:56.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50859
23242024-12-12T22:39:56.093ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23252024-12-12T22:39:56.142ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23262024-12-12T22:39:56.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123461 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50859 req_id = e89f2cd1-1578-4fff-be7c-40fbc72aabb4 response_code = 204 uri = /switch-ports
23272024-12-12T22:39:56.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40197
23282024-12-12T22:39:56.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40197 req_id = 566f3404-fa58-4e96-bcaf-5818c7a83161 response_code = 200 uri = /v2p
23292024-12-12T22:39:56.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50859 req_id = 87cebc56-6b7a-4656-b7dc-181ca9f8923a response_code = 200 uri = /network-bootstore-config
23302024-12-12T22:39:56.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62040
23312024-12-12T22:39:56.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62040 req_id = b9aedb92-62f4-4f55-b3ce-31bca5d39f5e response_code = 200 uri = /vpc-routes
23322024-12-12T22:39:56.474ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
23332024-12-12T22:39:56.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62040 req_id = cb7c3800-7003-4e76-8c9c-f72c3d675a1a response_code = 204 uri = /eip-gateways
23342024-12-12T22:39:56.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62040 req_id = 8b62fe87-fec8-4f01-b48b-63427bad1676 response_code = 204 uri = /vpc-routes
23352024-12-12T22:39:56.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52455
23362024-12-12T22:39:56.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52455 req_id = c03fd018-ce42-47de-963c-8e61ab9d5990 response_code = 200 uri = /v2p
23372024-12-12T22:39:56.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48516
23382024-12-12T22:39:56.525ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23392024-12-12T22:39:56.563ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23402024-12-12T22:39:56.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89247 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48516 req_id = 60958686-b1d1-491a-9573-49dc6c242764 response_code = 204 uri = /switch-ports
23412024-12-12T22:39:56.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48516 req_id = df984055-71e1-49a1-a8ac-77f89a77a217 response_code = 200 uri = /network-bootstore-config
23422024-12-12T22:40:02.198ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5501 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = c8e5ff1a-f43e-45b9-b6aa-05a51620b3ef response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
23432024-12-12T22:40:11.049ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36130
23442024-12-12T22:40:11.049ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36130 req_id = 3ef7b503-1d75-470b-9e85-95dc9774db12 response_code = 200 uri = /baseboard
23452024-12-12T22:40:25.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61279
23462024-12-12T22:40:25.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61279 req_id = a125b4ab-8238-4382-880b-9f6ddd1831ba response_code = 200 uri = /vpc-routes
23472024-12-12T22:40:25.476ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
23482024-12-12T22:40:25.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61279 req_id = 205ed8d6-471f-483a-8df0-3df03a28abd8 response_code = 204 uri = /eip-gateways
23492024-12-12T22:40:25.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41190
23502024-12-12T22:40:25.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41190 req_id = f29bc209-931e-4ed4-8ac5-babdc980f035 response_code = 200 uri = /v2p
23512024-12-12T22:40:25.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61279 req_id = e02470cc-ad09-4c3f-b417-91b26aa60c80 response_code = 204 uri = /vpc-routes
23522024-12-12T22:40:25.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41540
23532024-12-12T22:40:25.627ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23542024-12-12T22:40:25.663ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23552024-12-12T22:40:25.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91704 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41540 req_id = cdd25994-e85b-48b6-abab-7b1f455c8074 response_code = 204 uri = /switch-ports
23562024-12-12T22:40:25.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41540 req_id = 3f65e539-5c2c-46a1-9ef3-ac089ac86da7 response_code = 200 uri = /network-bootstore-config
23572024-12-12T22:40:26.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38802
23582024-12-12T22:40:26.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38802 req_id = 86a3edf4-04f6-4066-b357-4b3d654bf8dd response_code = 200 uri = /vpc-routes
23592024-12-12T22:40:26.276ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
23602024-12-12T22:40:26.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38802 req_id = f308eb58-d5d7-4503-9742-b4a9ddae71dc response_code = 204 uri = /eip-gateways
23612024-12-12T22:40:26.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38802 req_id = b4a98ebf-51ff-4ab1-a054-ea4fd8be2b4e response_code = 204 uri = /vpc-routes
23622024-12-12T22:40:26.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64782
23632024-12-12T22:40:26.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64782 req_id = 137010a2-9136-44fc-a61d-0d0c3eb8ee11 response_code = 200 uri = /vpc-routes
23642024-12-12T22:40:26.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56868
23652024-12-12T22:40:26.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56868 req_id = f9f9a961-dbea-4284-b04b-6ab9e1d4d9cb response_code = 200 uri = /v2p
23662024-12-12T22:40:26.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52842
23672024-12-12T22:40:26.377ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23682024-12-12T22:40:26.421ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23692024-12-12T22:40:26.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108138 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52842 req_id = f6ad1e3d-7e8b-4628-b28b-2bff9b8f8267 response_code = 204 uri = /switch-ports
23702024-12-12T22:40:26.486ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
23712024-12-12T22:40:26.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64782 req_id = f153bbe6-8596-4691-bb38-865639a9149d response_code = 204 uri = /eip-gateways
23722024-12-12T22:40:26.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64782 req_id = e19f3dab-8c35-42b5-8bfa-3ea03a1e298d response_code = 204 uri = /vpc-routes
23732024-12-12T22:40:26.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52842 req_id = 5853fd70-42ec-4bec-a4a2-16389a55c705 response_code = 200 uri = /network-bootstore-config
23742024-12-12T22:40:26.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43460
23752024-12-12T22:40:26.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43460 req_id = 25bdb5cb-9bf8-4404-aa00-623e2be9dcd6 response_code = 200 uri = /v2p
23762024-12-12T22:40:26.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54061
23772024-12-12T22:40:26.711ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23782024-12-12T22:40:26.746ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23792024-12-12T22:40:26.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86087 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54061 req_id = 80471fde-a590-42e5-a0a0-24b5d5187656 response_code = 204 uri = /switch-ports
23802024-12-12T22:40:26.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54061 req_id = 5e65c8e8-084d-426d-8de9-770d3cd10741 response_code = 200 uri = /network-bootstore-config
23812024-12-12T22:40:32.200ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6821 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = f552e678-e3b8-413b-815b-20de4b9bcba4 response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
23822024-12-12T22:40:41.082ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41052
23832024-12-12T22:40:41.082ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41052 req_id = 2496e542-49e2-4b2f-9652-6162c29b6844 response_code = 200 uri = /baseboard
23842024-12-12T22:40:48.257ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23852024-12-12T22:40:48.257ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23862024-12-12T22:40:48.287ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 4379, tv_nsec: 208747882 } time_to_next_cleanup = 599.99999454s
23872024-12-12T22:40:55.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51163
23882024-12-12T22:40:55.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51163 req_id = ce25120a-5c27-4a8c-8dbb-5581ef9c6e79 response_code = 200 uri = /v2p
23892024-12-12T22:40:55.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44044
23902024-12-12T22:40:55.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44044 req_id = 0f2cb4a4-e39b-4a3b-b237-a7b6db29c3af response_code = 200 uri = /vpc-routes
23912024-12-12T22:40:55.403ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
23922024-12-12T22:40:55.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44044 req_id = 7f480ca8-c94d-4b58-83e1-cedf0abce0b2 response_code = 204 uri = /eip-gateways
23932024-12-12T22:40:55.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44044 req_id = 78285957-296e-4b4f-abec-6369b2dd25f6 response_code = 204 uri = /vpc-routes
23942024-12-12T22:40:55.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59806
23952024-12-12T22:40:55.458ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23962024-12-12T22:40:55.497ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23972024-12-12T22:40:55.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90201 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59806 req_id = 05902779-8082-44bc-bc63-07cd6c2e24c1 response_code = 204 uri = /switch-ports
23982024-12-12T22:40:55.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59806 req_id = 6fecb842-3b56-4e3b-8140-9bd35017a573 response_code = 200 uri = /network-bootstore-config
23992024-12-12T22:40:55.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39655
24002024-12-12T22:40:55.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39655 req_id = 6b450d79-8905-4970-af5a-ebc9a5c6e2d2 response_code = 200 uri = /vpc-routes
24012024-12-12T22:40:55.982ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
24022024-12-12T22:40:55.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39655 req_id = b022bbfe-c105-4a32-b3b5-94e7d8d1ba35 response_code = 204 uri = /eip-gateways
24032024-12-12T22:40:55.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39655 req_id = 0e36719c-f640-4699-8d38-1bd68f87c3a7 response_code = 204 uri = /vpc-routes
24042024-12-12T22:40:56.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61530
24052024-12-12T22:40:56.113ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24062024-12-12T22:40:56.163ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24072024-12-12T22:40:56.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128316 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61530 req_id = 25767e40-668e-4d9d-a141-dd8b71fcf020 response_code = 204 uri = /switch-ports
24082024-12-12T22:40:56.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47612
24092024-12-12T22:40:56.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61530 req_id = 523595a5-0f67-4963-b68e-0570e40b4433 response_code = 200 uri = /network-bootstore-config
24102024-12-12T22:40:56.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47612 req_id = 17ec8a0a-6435-47e2-97b2-481e37fbf3d3 response_code = 200 uri = /v2p
24112024-12-12T22:40:56.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54947
24122024-12-12T22:40:56.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54947 req_id = 86252ebc-952c-44e4-8b12-222e82e76a19 response_code = 200 uri = /vpc-routes
24132024-12-12T22:40:56.345ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
24142024-12-12T22:40:56.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54947 req_id = 245d9a6d-14f2-47e4-b77e-7727d21bee2a response_code = 204 uri = /eip-gateways
24152024-12-12T22:40:56.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54947 req_id = 3e6331aa-26db-412b-9926-2b7d0f648273 response_code = 204 uri = /vpc-routes
24162024-12-12T22:40:56.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61392
24172024-12-12T22:40:56.378ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24182024-12-12T22:40:56.418ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24192024-12-12T22:40:56.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106568 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61392 req_id = 4e34edb0-d338-4439-b1e6-b30413521678 response_code = 204 uri = /switch-ports
24202024-12-12T22:40:56.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61392 req_id = 378511ff-9fe1-4d4a-a69c-a2b64c802393 response_code = 200 uri = /network-bootstore-config
24212024-12-12T22:40:56.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37013
24222024-12-12T22:40:56.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37013 req_id = d860c212-b086-4bd9-af12-a1e5f7658f80 response_code = 200 uri = /v2p
24232024-12-12T22:41:02.199ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6783 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = 7c996e4c-c7bb-4e34-a24e-56ac5c2268a8 response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
24242024-12-12T22:41:02.411ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24252024-12-12T22:41:11.117ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55275
24262024-12-12T22:41:11.117ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55275 req_id = 70485d38-5773-4007-94b8-2b55ee1ba9a6 response_code = 200 uri = /baseboard
24272024-12-12T22:41:25.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64841
24282024-12-12T22:41:25.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64841 req_id = 2bc980a4-f774-400d-9873-5c4e93dada01 response_code = 200 uri = /vpc-routes
24292024-12-12T22:41:25.478ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
24302024-12-12T22:41:25.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64841 req_id = 8ffc11a0-05a2-4880-9e09-fb711060820a response_code = 204 uri = /eip-gateways
24312024-12-12T22:41:25.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45702
24322024-12-12T22:41:25.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45702 req_id = 01796cc8-e7dd-4767-82d2-f4b6c61dec94 response_code = 200 uri = /v2p
24332024-12-12T22:41:25.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64841 req_id = 52b9f018-9c6a-4c75-8f4a-d3538c1254aa response_code = 204 uri = /vpc-routes
24342024-12-12T22:41:25.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56710
24352024-12-12T22:41:25.561ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24362024-12-12T22:41:25.599ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24372024-12-12T22:41:25.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92833 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56710 req_id = 5510209d-678f-4ba4-adcb-2356f6b53c62 response_code = 204 uri = /switch-ports
24382024-12-12T22:41:25.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56710 req_id = 1cfadbf1-0998-4123-b9d7-21bd5d01ecc5 response_code = 200 uri = /network-bootstore-config
24392024-12-12T22:41:26.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42398
24402024-12-12T22:41:26.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42398 req_id = b886878a-13f0-4c98-a77b-2cfae6f1bfb2 response_code = 200 uri = /v2p
24412024-12-12T22:41:26.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64341
24422024-12-12T22:41:26.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64341 req_id = e74f12c3-4a81-463c-afb6-5de05cc6b23c response_code = 200 uri = /vpc-routes
24432024-12-12T22:41:26.343ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
24442024-12-12T22:41:26.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64341 req_id = 303a41d6-9119-4382-b542-48b5f37c4b54 response_code = 204 uri = /eip-gateways
24452024-12-12T22:41:26.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64341 req_id = aa6b0622-72cd-44b0-9eb1-0547605d3309 response_code = 204 uri = /vpc-routes
24462024-12-12T22:41:26.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64776
24472024-12-12T22:41:26.443ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24482024-12-12T22:41:26.483ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24492024-12-12T22:41:26.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95825 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64776 req_id = b86f39ad-9131-4fff-84b9-39e115ba4571 response_code = 204 uri = /switch-ports
24502024-12-12T22:41:26.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50403
24512024-12-12T22:41:26.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54607
24522024-12-12T22:41:26.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64776 req_id = e4286346-0cb4-4959-9510-35ba35ba6d43 response_code = 200 uri = /network-bootstore-config
24532024-12-12T22:41:26.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50403 req_id = a805ebd5-3fba-4d0b-93f2-c2c7e0b3322c response_code = 200 uri = /vpc-routes
24542024-12-12T22:41:26.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54607 req_id = 4ce64571-c0a4-463b-9a62-63cf4d18771f response_code = 200 uri = /v2p
24552024-12-12T22:41:26.555ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
24562024-12-12T22:41:26.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50403 req_id = 69912428-49a5-46a1-9b05-c0f9ec09ee4a response_code = 204 uri = /eip-gateways
24572024-12-12T22:41:26.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50403 req_id = a192d439-d93f-4c75-8bd9-62c7b409f71a response_code = 204 uri = /vpc-routes
24582024-12-12T22:41:26.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46855
24592024-12-12T22:41:26.705ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24602024-12-12T22:41:26.742ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24612024-12-12T22:41:26.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91127 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46855 req_id = 4a7f735d-9ae1-4cee-8371-b8920bbd9622 response_code = 204 uri = /switch-ports
24622024-12-12T22:41:26.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46855 req_id = ef4d8d86-5dd1-40ee-84be-5840960bea2d response_code = 200 uri = /network-bootstore-config
24632024-12-12T22:41:32.199ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5658 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = 79425e08-0ff9-434b-babd-03013cdddcae response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
24642024-12-12T22:41:41.150ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43029
24652024-12-12T22:41:41.150ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43029 req_id = cec40d82-c135-406e-b9e9-b3066974e703 response_code = 200 uri = /baseboard
24662024-12-12T22:41:55.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63611
24672024-12-12T22:41:55.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63611 req_id = 46f21b69-e2a0-4a18-b232-5c44805e92f5 response_code = 200 uri = /vpc-routes
24682024-12-12T22:41:55.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62312
24692024-12-12T22:41:55.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62312 req_id = 25f13b8b-735e-44ca-bd0d-22b72b16d86f response_code = 200 uri = /v2p
24702024-12-12T22:41:55.422ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
24712024-12-12T22:41:55.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63611 req_id = af27a2c0-52e6-4e93-9dfd-0339f86f4642 response_code = 204 uri = /eip-gateways
24722024-12-12T22:41:55.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63611 req_id = 9201fcb5-aff7-415f-9748-887c19acb9ed response_code = 204 uri = /vpc-routes
24732024-12-12T22:41:55.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43128
24742024-12-12T22:41:55.465ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24752024-12-12T22:41:55.504ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24762024-12-12T22:41:55.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91867 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43128 req_id = a7fb0533-8344-43c6-98e7-6ebfe8f533d7 response_code = 204 uri = /switch-ports
24772024-12-12T22:41:55.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43128 req_id = b2d450d8-deca-4fbf-b081-a16de2d5a354 response_code = 200 uri = /network-bootstore-config
24782024-12-12T22:41:56.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54638
24792024-12-12T22:41:56.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54638 req_id = d0ec63cd-73ec-4709-8588-cab96b3ce232 response_code = 200 uri = /vpc-routes
24802024-12-12T22:41:56.045ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
24812024-12-12T22:41:56.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54638 req_id = 379fd56c-c82d-4171-a84d-d5b16e54a6b6 response_code = 204 uri = /eip-gateways
24822024-12-12T22:41:56.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54638 req_id = 494f70cb-1aa2-4c80-8eef-751be862874c response_code = 204 uri = /vpc-routes
24832024-12-12T22:41:56.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35055
24842024-12-12T22:41:56.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35055 req_id = b7d4c3a9-2687-4404-8057-58a55c1f3c3d response_code = 200 uri = /v2p
24852024-12-12T22:41:56.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33442
24862024-12-12T22:41:56.084ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24872024-12-12T22:41:56.128ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24882024-12-12T22:41:56.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106398 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33442 req_id = 5f8d82f1-1214-4201-85b3-8b9d71ae7e27 response_code = 204 uri = /switch-ports
24892024-12-12T22:41:56.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33442 req_id = ce3bcff6-dc95-4147-b2f9-53a75e1550c4 response_code = 200 uri = /network-bootstore-config
24902024-12-12T22:41:56.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35760
24912024-12-12T22:41:56.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35760 req_id = 69dd5444-d7ed-44fe-92d7-1944a411de2d response_code = 200 uri = /vpc-routes
24922024-12-12T22:41:56.310ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
24932024-12-12T22:41:56.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35760 req_id = 844bf62b-ee95-4f38-8007-355de0af307f response_code = 204 uri = /eip-gateways
24942024-12-12T22:41:56.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35760 req_id = 69cb6db0-d263-4535-ae9b-a40c5191b809 response_code = 204 uri = /vpc-routes
24952024-12-12T22:41:56.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64385
24962024-12-12T22:41:56.401ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24972024-12-12T22:41:56.440ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24982024-12-12T22:41:56.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99064 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64385 req_id = 934dc6ea-3a55-4c2d-be68-b8e87bd78cef response_code = 204 uri = /switch-ports
24992024-12-12T22:41:56.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64385 req_id = 871cb637-9df6-43e0-821a-0be681141b2d response_code = 200 uri = /network-bootstore-config
25002024-12-12T22:41:56.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54772
25012024-12-12T22:41:56.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54772 req_id = 812fe64c-2f9d-4427-b9db-2f4cc6403dba response_code = 200 uri = /v2p
25022024-12-12T22:42:02.200ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7198 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = 66a79da3-75d3-4586-9967-2d17a2c6eca1 response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
25032024-12-12T22:42:11.183ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61010
25042024-12-12T22:42:11.183ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61010 req_id = 4a2a3418-ab5c-4f1e-a894-ba466d1b691b response_code = 200 uri = /baseboard
25052024-12-12T22:42:25.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45849
25062024-12-12T22:42:25.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45849 req_id = 111ee441-5ebd-4267-8664-b4e1d38484d3 response_code = 200 uri = /vpc-routes
25072024-12-12T22:42:25.435ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
25082024-12-12T22:42:25.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45849 req_id = 5b558429-243e-4fd9-9613-15860dad21fa response_code = 204 uri = /eip-gateways
25092024-12-12T22:42:25.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45849 req_id = 4977ee4e-a120-45c8-8ece-91af6b74f671 response_code = 204 uri = /vpc-routes
25102024-12-12T22:42:25.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59888
25112024-12-12T22:42:25.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59888 req_id = 9180a8db-1873-4637-aae2-27fa04d5af04 response_code = 200 uri = /v2p
25122024-12-12T22:42:25.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61635
25132024-12-12T22:42:25.727ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25142024-12-12T22:42:25.766ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25152024-12-12T22:42:25.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98215 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61635 req_id = 97d45830-4ae3-451a-b963-001e21ad4e0d response_code = 204 uri = /switch-ports
25162024-12-12T22:42:25.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61635 req_id = 53d1071d-4e32-4aa8-a804-7d339a3f6a3d response_code = 200 uri = /network-bootstore-config
25172024-12-12T22:42:26.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53794
25182024-12-12T22:42:26.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53794 req_id = ee14bc1d-0cf3-437a-af7b-619cbefd6a8a response_code = 200 uri = /vpc-routes
25192024-12-12T22:42:26.127ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
25202024-12-12T22:42:26.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53794 req_id = 4b24dbfd-9442-492e-82d6-c3e39deee359 response_code = 204 uri = /eip-gateways
25212024-12-12T22:42:26.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42723
25222024-12-12T22:42:26.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42723 req_id = 3a2c8947-2f57-483d-915d-e9c30c9e6c2c response_code = 200 uri = /v2p
25232024-12-12T22:42:26.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53794 req_id = 817107c0-a62f-4b56-93d7-cfe616df11be response_code = 204 uri = /vpc-routes
25242024-12-12T22:42:26.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50720
25252024-12-12T22:42:26.382ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25262024-12-12T22:42:26.422ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25272024-12-12T22:42:26.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96939 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50720 req_id = 9ba82ebd-d413-4750-b5cd-ce237d45c37b response_code = 204 uri = /switch-ports
25282024-12-12T22:42:26.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50720 req_id = 28de249c-c889-450b-a55a-02073750dd79 response_code = 200 uri = /network-bootstore-config
25292024-12-12T22:42:26.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62975
25302024-12-12T22:42:26.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62975 req_id = e801c4b5-536f-493d-818a-2b20d449c8c5 response_code = 200 uri = /vpc-routes
25312024-12-12T22:42:26.534ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
25322024-12-12T22:42:26.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62975 req_id = 9d6cc1fb-3751-4727-8819-7c0f06c1a0f4 response_code = 204 uri = /eip-gateways
25332024-12-12T22:42:26.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62975 req_id = f851b165-9da3-456c-b78e-a8e4acf31ca2 response_code = 204 uri = /vpc-routes
25342024-12-12T22:42:26.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47798
25352024-12-12T22:42:26.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47798 req_id = df1a157a-a89f-4eae-9a37-2e315b3f9634 response_code = 200 uri = /v2p
25362024-12-12T22:42:26.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54482
25372024-12-12T22:42:26.697ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25382024-12-12T22:42:26.733ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25392024-12-12T22:42:26.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96423 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54482 req_id = 9f82d492-6178-45d0-969b-5148fa99d5f1 response_code = 204 uri = /switch-ports
25402024-12-12T22:42:26.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54482 req_id = d5b84e94-0bf2-4f44-8fcf-d75501e5f836 response_code = 200 uri = /network-bootstore-config
25412024-12-12T22:42:32.200ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6774 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = 3327ab31-7630-4173-9b9a-47cdea4e5fa7 response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
25422024-12-12T22:42:41.217ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56829
25432024-12-12T22:42:41.217ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56829 req_id = 6a738e15-797d-4e3e-98e2-30c7857a3248 response_code = 200 uri = /baseboard
25442024-12-12T22:42:55.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60537
25452024-12-12T22:42:55.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60537 req_id = a365b90c-89ab-470a-9314-a0010fda13eb response_code = 200 uri = /vpc-routes
25462024-12-12T22:42:55.319ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
25472024-12-12T22:42:55.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60537 req_id = e5445503-051b-4123-ae87-7a1feafa29c2 response_code = 204 uri = /eip-gateways
25482024-12-12T22:42:55.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35516
25492024-12-12T22:42:55.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35516 req_id = d5089456-0ef0-4502-9e0b-acec2685b069 response_code = 200 uri = /v2p
25502024-12-12T22:42:55.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60537 req_id = 9d6fe907-40be-45e8-941c-bdf530ec0900 response_code = 204 uri = /vpc-routes
25512024-12-12T22:42:55.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60375
25522024-12-12T22:42:55.455ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25532024-12-12T22:42:55.495ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25542024-12-12T22:42:55.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99480 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60375 req_id = 45bb683a-cd9e-40d4-bd96-61ee302d4839 response_code = 204 uri = /switch-ports
25552024-12-12T22:42:55.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60375 req_id = 7358dbc5-05b2-4482-807b-4ca2bbc03593 response_code = 200 uri = /network-bootstore-config
25562024-12-12T22:42:56.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46504
25572024-12-12T22:42:56.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46504 req_id = ce9a4909-7751-4d05-b205-73dd092e92b1 response_code = 200 uri = /vpc-routes
25582024-12-12T22:42:56.051ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
25592024-12-12T22:42:56.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46504 req_id = 9c44df9f-04f9-4a78-be96-f947c4930c41 response_code = 204 uri = /eip-gateways
25602024-12-12T22:42:56.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46504 req_id = 2917de1d-f790-4487-82f2-aa1e91a74b69 response_code = 204 uri = /vpc-routes
25612024-12-12T22:42:56.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36841
25622024-12-12T22:42:56.092ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25632024-12-12T22:42:56.143ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25642024-12-12T22:42:56.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133602 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36841 req_id = 1c555eec-8952-48f4-a441-fc0e4835e7a3 response_code = 204 uri = /switch-ports
25652024-12-12T22:42:56.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59641
25662024-12-12T22:42:56.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36841 req_id = 8458eea5-3394-44bd-9e84-3167fb6bf749 response_code = 200 uri = /network-bootstore-config
25672024-12-12T22:42:56.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59641 req_id = 7947e652-010f-4c9e-a3cf-5b01fabab992 response_code = 200 uri = /v2p
25682024-12-12T22:42:56.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53375
25692024-12-12T22:42:56.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53375 req_id = fff09542-d4de-4352-92b3-ad192a4b70d5 response_code = 200 uri = /v2p
25702024-12-12T22:42:56.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48948
25712024-12-12T22:42:56.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48948 req_id = bd985a51-4d0d-49e8-a7e0-d28d47dc72b3 response_code = 200 uri = /vpc-routes
25722024-12-12T22:42:56.363ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
25732024-12-12T22:42:56.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48948 req_id = 96166183-6ea1-4626-9284-e68f87849239 response_code = 204 uri = /eip-gateways
25742024-12-12T22:42:56.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48948 req_id = 84f77f01-b819-40b4-913c-dfeb359bc6ad response_code = 204 uri = /vpc-routes
25752024-12-12T22:42:56.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48318
25762024-12-12T22:42:56.392ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25772024-12-12T22:42:56.432ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25782024-12-12T22:42:56.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95655 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48318 req_id = 8ed68299-4c5e-4d46-8bec-01e4d21889d3 response_code = 204 uri = /switch-ports
25792024-12-12T22:42:56.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48318 req_id = 4cafe7bc-7a7e-44ab-b075-2a69a5f5caa1 response_code = 200 uri = /network-bootstore-config
25802024-12-12T22:43:02.199ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6309 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = 27dd59a1-fc16-4114-98b8-e591f39404e0 response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
25812024-12-12T22:43:11.252ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65357
25822024-12-12T22:43:11.252ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65357 req_id = 904f4e80-5996-47cc-81e4-88ba646bce8b response_code = 200 uri = /baseboard
25832024-12-12T22:43:25.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54870
25842024-12-12T22:43:25.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54870 req_id = e3d1dd94-3d1c-4e52-ae90-8f841ba038d8 response_code = 200 uri = /vpc-routes
25852024-12-12T22:43:25.376ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
25862024-12-12T22:43:25.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54870 req_id = 7d54a76d-0f72-4d1f-a28a-c26d96d8dcd7 response_code = 204 uri = /eip-gateways
25872024-12-12T22:43:25.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54870 req_id = 64d5f975-337b-4ddf-977d-9f75d48b610b response_code = 204 uri = /vpc-routes
25882024-12-12T22:43:25.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60450
25892024-12-12T22:43:25.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60450 req_id = 934d928e-0bb8-4777-be75-7f9febc491a5 response_code = 200 uri = /v2p
25902024-12-12T22:43:25.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65040
25912024-12-12T22:43:25.623ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25922024-12-12T22:43:25.661ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25932024-12-12T22:43:25.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95316 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65040 req_id = c577f23e-25c2-420b-91f7-0a6a3af6ab4a response_code = 204 uri = /switch-ports
25942024-12-12T22:43:25.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65040 req_id = 7084aee3-c009-47c5-b46f-9bfcfbe4daaa response_code = 200 uri = /network-bootstore-config
25952024-12-12T22:43:26.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51955
25962024-12-12T22:43:26.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51955 req_id = 7afdd240-bb4a-4a22-bf94-bb9fbe7ac2a8 response_code = 200 uri = /vpc-routes
25972024-12-12T22:43:26.095ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
25982024-12-12T22:43:26.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51955 req_id = 5af4df1b-a65d-4e5c-a236-59fa87079ed6 response_code = 204 uri = /eip-gateways
25992024-12-12T22:43:26.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51955 req_id = 5d895ff4-4768-4249-9e38-94b98096c0dd response_code = 204 uri = /vpc-routes
26002024-12-12T22:43:26.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51786
26012024-12-12T22:43:26.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51786 req_id = 6cd5f01f-3b69-4842-8c5e-a8124bfe6a7a response_code = 200 uri = /vpc-routes
26022024-12-12T22:43:26.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49921
26032024-12-12T22:43:26.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49921 req_id = 40e93cdd-fb0c-4800-93bf-2b9f90a82d99 response_code = 200 uri = /v2p
26042024-12-12T22:43:26.386ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
26052024-12-12T22:43:26.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51786 req_id = 123383f9-caff-4ce6-b111-15e64fd98fc6 response_code = 204 uri = /eip-gateways
26062024-12-12T22:43:26.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51786 req_id = 79892abc-ca4a-4c35-a696-b4ee7afddac3 response_code = 204 uri = /vpc-routes
26072024-12-12T22:43:26.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56239
26082024-12-12T22:43:26.427ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26092024-12-12T22:43:26.467ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26102024-12-12T22:43:26.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96637 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56239 req_id = 88544f4b-9dbe-441e-90f7-60ec3b8ef2c6 response_code = 204 uri = /switch-ports
26112024-12-12T22:43:26.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56239 req_id = af637007-560d-4389-b02f-4c26c497a7db response_code = 200 uri = /network-bootstore-config
26122024-12-12T22:43:26.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40866
26132024-12-12T22:43:26.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40866 req_id = 8f03b929-7d97-4546-a29b-df458d4c87c9 response_code = 200 uri = /v2p
26142024-12-12T22:43:26.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64017
26152024-12-12T22:43:26.594ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26162024-12-12T22:43:26.628ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26172024-12-12T22:43:26.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83703 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64017 req_id = e1fecbe2-3bf7-4eef-9e4e-040f9958859e response_code = 204 uri = /switch-ports
26182024-12-12T22:43:26.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64017 req_id = 72dab0ba-6814-49ce-81f9-5e70aadd34f4 response_code = 200 uri = /network-bootstore-config
26192024-12-12T22:43:32.200ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7406 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = 8a328e1e-7737-4320-802a-ba7fe597b91f response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
26202024-12-12T22:43:41.286ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45353
26212024-12-12T22:43:41.286ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45353 req_id = de43508e-6e37-4e5b-a1b2-f19f69e40232 response_code = 200 uri = /baseboard
26222024-12-12T22:43:55.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59171
26232024-12-12T22:43:55.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59171 req_id = 96fc43c1-132a-4a0c-a979-fc512c6153aa response_code = 200 uri = /vpc-routes
26242024-12-12T22:43:55.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37868
26252024-12-12T22:43:55.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37868 req_id = 776e834b-76a1-4f4d-a2f7-25252d533342 response_code = 200 uri = /v2p
26262024-12-12T22:43:55.516ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
26272024-12-12T22:43:55.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59171 req_id = f92032cd-e33e-4806-8d61-87f9ee4ac2df response_code = 204 uri = /eip-gateways
26282024-12-12T22:43:55.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59171 req_id = 4ff16fa4-5608-48a5-9107-987decbae3fa response_code = 204 uri = /vpc-routes
26292024-12-12T22:43:55.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51278
26302024-12-12T22:43:55.567ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26312024-12-12T22:43:55.606ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26322024-12-12T22:43:55.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93445 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51278 req_id = 4188993e-e70a-4473-a20b-03a1508fb137 response_code = 204 uri = /switch-ports
26332024-12-12T22:43:55.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51278 req_id = b4a698ec-42cc-46d2-a7e0-d3749f86c40b response_code = 200 uri = /network-bootstore-config
26342024-12-12T22:43:56.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51870
26352024-12-12T22:43:56.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51870 req_id = d2961522-2f9a-4f3e-b217-f37cf1a211c6 response_code = 200 uri = /vpc-routes
26362024-12-12T22:43:56.102ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
26372024-12-12T22:43:56.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51870 req_id = bcfacd6d-301c-4dfd-99d2-7c53443da056 response_code = 204 uri = /eip-gateways
26382024-12-12T22:43:56.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32776
26392024-12-12T22:43:56.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32776 req_id = dfb4bf51-2031-4c9d-b1fa-5a816beb2f12 response_code = 200 uri = /v2p
26402024-12-12T22:43:56.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51870 req_id = 29c11330-d8cf-4fa7-aa4d-64f5c2a9a373 response_code = 204 uri = /vpc-routes
26412024-12-12T22:43:56.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56525
26422024-12-12T22:43:56.180ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26432024-12-12T22:43:56.222ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26442024-12-12T22:43:56.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99454 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56525 req_id = 8ef3815b-ef88-4fe9-affd-c133612476f4 response_code = 204 uri = /switch-ports
26452024-12-12T22:43:56.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33350
26462024-12-12T22:43:56.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33350 req_id = de496c81-506f-4720-8085-181d89745de7 response_code = 200 uri = /vpc-routes
26472024-12-12T22:43:56.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56525 req_id = 51d69c9d-c9cb-4dfa-9c49-61ee4111ba9b response_code = 200 uri = /network-bootstore-config
26482024-12-12T22:43:56.296ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
26492024-12-12T22:43:56.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33350 req_id = 5b488759-4c81-48cf-bbe8-e89184066528 response_code = 204 uri = /eip-gateways
26502024-12-12T22:43:56.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33350 req_id = 8a3e9bc0-6d4d-4421-ad96-d3074611d020 response_code = 204 uri = /vpc-routes
26512024-12-12T22:43:56.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42929
26522024-12-12T22:43:56.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42929 req_id = 0868135e-1904-4b05-8855-66203ad9d375 response_code = 200 uri = /v2p
26532024-12-12T22:43:56.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47748
26542024-12-12T22:43:56.386ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26552024-12-12T22:43:56.426ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26562024-12-12T22:43:56.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97775 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47748 req_id = 05934712-6371-4d30-8f5d-7982af6aaafa response_code = 204 uri = /switch-ports
26572024-12-12T22:43:56.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47748 req_id = 7d9382b3-de02-4c61-b349-3e00e54d87d9 response_code = 200 uri = /network-bootstore-config
26582024-12-12T22:44:02.200ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6914 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = 7bbbb636-ebbc-4e90-8794-4d5b3e3aff5e response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
26592024-12-12T22:44:11.319ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60659
26602024-12-12T22:44:11.319ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60659 req_id = 1af334d2-1b60-43e0-9808-6ccf825241d4 response_code = 200 uri = /baseboard
26612024-12-12T22:44:25.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39021
26622024-12-12T22:44:25.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39021 req_id = 8a974417-bc47-466e-aa18-f0a2f9871bcd response_code = 200 uri = /vpc-routes
26632024-12-12T22:44:25.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38276
26642024-12-12T22:44:25.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38276 req_id = 5c97ee18-ce48-4768-ad16-a4c9a0322a33 response_code = 200 uri = /v2p
26652024-12-12T22:44:25.804ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34910
26662024-12-12T22:44:25.804ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26672024-12-12T22:44:25.861ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26682024-12-12T22:44:25.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138457 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34910 req_id = e246e6d7-ce78-45ea-8ace-bdb036e447b2 response_code = 204 uri = /switch-ports
26692024-12-12T22:44:25.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40131
26702024-12-12T22:44:25.943ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
26712024-12-12T22:44:25.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39021 req_id = 875aaf4b-f61e-4096-9df8-81c487d2b574 response_code = 204 uri = /eip-gateways
26722024-12-12T22:44:25.943ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26732024-12-12T22:44:25.943ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26742024-12-12T22:44:25.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 374 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34910 req_id = d4db4ca4-8cd8-4bfc-b7f8-0ae90b00e977 response_code = 200 uri = /network-bootstore-config
26752024-12-12T22:44:25.944ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/omicron-zones.json file = common/src/ledger.rs:177
26762024-12-12T22:44:25.944ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/omicron-zones.json file = common/src/ledger.rs:177
26772024-12-12T22:44:25.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39021 req_id = b7b7262e-8f57-4cba-b467-bacc516737b5 response_code = 204 uri = /vpc-routes
26782024-12-12T22:44:25.959ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26792024-12-12T22:44:25.959ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7
26802024-12-12T22:44:25.988ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26812024-12-12T22:44:25.988ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908
26822024-12-12T22:44:26.018ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26832024-12-12T22:44:26.018ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_662d717a-a0c0-4538-854a-f7813f739fb9
26842024-12-12T22:44:26.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36414
26852024-12-12T22:44:26.026ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26862024-12-12T22:44:26.026ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26872024-12-12T22:44:26.026ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26882024-12-12T22:44:26.026ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26892024-12-12T22:44:26.026ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26902024-12-12T22:44:26.026ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26912024-12-12T22:44:26.026ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26922024-12-12T22:44:26.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 432 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36414 req_id = ef18c842-60b0-448d-83c1-4f5c279dbc58 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26932024-12-12T22:44:26.043ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26942024-12-12T22:44:26.043ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_06e7bad6-773d-4089-9ade-6e4f457beccc
26952024-12-12T22:44:26.065ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26962024-12-12T22:44:26.065ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5
26972024-12-12T22:44:26.088ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26982024-12-12T22:44:26.088ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3c596d62-0729-49f7-ab54-437e3babc937
26992024-12-12T22:44:26.109ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27002024-12-12T22:44:26.109ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ffe707ac-7f49-497d-beef-33098ae2bcc4
27012024-12-12T22:44:26.148ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27022024-12-12T22:44:26.148ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0101354b-4aed-4a3c-aa42-78e2e2510c9b
27032024-12-12T22:44:26.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57745
27042024-12-12T22:44:26.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57745 req_id = e5bdf195-d4ca-4451-af8f-475214563572 response_code = 200 uri = /vpc-routes
27052024-12-12T22:44:26.196ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
27062024-12-12T22:44:26.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57745 req_id = 9fa66306-b896-4f09-84e0-362b0f848911 response_code = 204 uri = /eip-gateways
27072024-12-12T22:44:26.199ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27082024-12-12T22:44:26.199ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8ec50946-b029-4583-84f3-35d2ce5b9dff
27092024-12-12T22:44:26.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275998 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40131 req_id = 97fd5c48-f65d-49ba-b623-145f8d77cc2a response_code = 200 uri = /inventory
27102024-12-12T22:44:26.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61804
27112024-12-12T22:44:26.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61804 req_id = c515dd83-150e-4eda-b6a9-bd5e50e93b98 response_code = 200 uri = /v2p
27122024-12-12T22:44:26.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59094
27132024-12-12T22:44:26.345ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27142024-12-12T22:44:26.345ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27152024-12-12T22:44:26.345ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/omicron-zones.json file = common/src/ledger.rs:177
27162024-12-12T22:44:26.345ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/omicron-zones.json file = common/src/ledger.rs:177
27172024-12-12T22:44:26.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57745 req_id = aec5645a-dc1a-4739-b78b-915e66ca50b3 response_code = 204 uri = /vpc-routes
27182024-12-12T22:44:26.363ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27192024-12-12T22:44:26.363ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7
27202024-12-12T22:44:26.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48386
27212024-12-12T22:44:26.368ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27222024-12-12T22:44:26.395ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27232024-12-12T22:44:26.395ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908
27242024-12-12T22:44:26.417ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27252024-12-12T22:44:26.424ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27262024-12-12T22:44:26.424ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_662d717a-a0c0-4538-854a-f7813f739fb9
27272024-12-12T22:44:26.456ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27282024-12-12T22:44:26.456ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_06e7bad6-773d-4089-9ade-6e4f457beccc
27292024-12-12T22:44:26.485ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27302024-12-12T22:44:26.485ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5
27312024-12-12T22:44:26.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122700 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48386 req_id = c9aa11b9-07bf-40ba-8298-79d740d2cdd6 response_code = 204 uri = /switch-ports
27322024-12-12T22:44:26.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48386 req_id = b5e5d2cc-7f3b-4d60-80d8-c74f64706d0b response_code = 200 uri = /network-bootstore-config
27332024-12-12T22:44:26.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48005
27342024-12-12T22:44:26.506ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27352024-12-12T22:44:26.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27362024-12-12T22:44:26.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27372024-12-12T22:44:26.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27382024-12-12T22:44:26.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27392024-12-12T22:44:26.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27402024-12-12T22:44:26.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27412024-12-12T22:44:26.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 578 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48005 req_id = da0ef8a9-fb47-4ab5-82e1-92372ef9ba69 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27422024-12-12T22:44:26.512ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27432024-12-12T22:44:26.512ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3c596d62-0729-49f7-ab54-437e3babc937
27442024-12-12T22:44:26.536ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27452024-12-12T22:44:26.536ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ffe707ac-7f49-497d-beef-33098ae2bcc4
27462024-12-12T22:44:26.559ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27472024-12-12T22:44:26.559ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0101354b-4aed-4a3c-aa42-78e2e2510c9b
27482024-12-12T22:44:26.580ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27492024-12-12T22:44:26.580ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8ec50946-b029-4583-84f3-35d2ce5b9dff
27502024-12-12T22:44:26.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59094 req_id = c9743c02-4e3c-4beb-8d64-c2adaadd9b79 response_code = 200 uri = /inventory
27512024-12-12T22:44:26.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51708
27522024-12-12T22:44:26.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51708 req_id = 2f09b19c-df0f-48ca-a729-40a42db09475 response_code = 200 uri = /vpc-routes
27532024-12-12T22:44:26.614ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
27542024-12-12T22:44:26.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51708 req_id = 56139c45-b95e-4bef-902e-ee511dd32a3e response_code = 204 uri = /eip-gateways
27552024-12-12T22:44:26.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60352
27562024-12-12T22:44:26.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60352 req_id = 548f3947-8bfa-4fc4-94d7-a6f79c983be2 response_code = 200 uri = /v2p
27572024-12-12T22:44:26.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61265
27582024-12-12T22:44:26.781ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27592024-12-12T22:44:26.781ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27602024-12-12T22:44:26.781ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27612024-12-12T22:44:26.781ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27622024-12-12T22:44:26.781ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27632024-12-12T22:44:26.781ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27642024-12-12T22:44:26.781ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27652024-12-12T22:44:26.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61265 req_id = 5ec5bc4b-f192-4db6-b5cc-53ee73f00445 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27662024-12-12T22:44:26.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51708 req_id = ffac5b7f-f632-4285-bb09-5109926354ff response_code = 204 uri = /vpc-routes
27672024-12-12T22:44:26.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36942
27682024-12-12T22:44:26.874ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27692024-12-12T22:44:26.915ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27702024-12-12T22:44:26.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98092 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36942 req_id = fd787b45-1aab-4d2a-ba6c-f0b8a5899900 response_code = 204 uri = /switch-ports
27712024-12-12T22:44:26.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59161
27722024-12-12T22:44:26.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36942 req_id = 235511dd-dbb9-466e-8d54-48965bf144d6 response_code = 200 uri = /network-bootstore-config
27732024-12-12T22:44:26.973ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27742024-12-12T22:44:26.973ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27752024-12-12T22:44:26.973ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/config/omicron-zones.json file = common/src/ledger.rs:177
27762024-12-12T22:44:26.973ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/config/omicron-zones.json file = common/src/ledger.rs:177
27772024-12-12T22:44:26.987ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 64cf57bb-ed1f-48c4-915e-9b1967f8e7d7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27782024-12-12T22:44:26.987ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_64cf57bb-ed1f-48c4-915e-9b1967f8e7d7
27792024-12-12T22:44:27.013ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 93ec67c2-740c-41e9-a5e6-8ae9202a7908 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27802024-12-12T22:44:27.013ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_93ec67c2-740c-41e9-a5e6-8ae9202a7908
27812024-12-12T22:44:27.037ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 662d717a-a0c0-4538-854a-f7813f739fb9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27822024-12-12T22:44:27.037ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_662d717a-a0c0-4538-854a-f7813f739fb9
27832024-12-12T22:44:27.060ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 06e7bad6-773d-4089-9ade-6e4f457beccc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27842024-12-12T22:44:27.060ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_06e7bad6-773d-4089-9ade-6e4f457beccc
27852024-12-12T22:44:27.084ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27862024-12-12T22:44:27.084ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8146c792-6a91-4f87-a5d5-73980d0b7ba5
27872024-12-12T22:44:27.107ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3c596d62-0729-49f7-ab54-437e3babc937 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27882024-12-12T22:44:27.107ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3c596d62-0729-49f7-ab54-437e3babc937
27892024-12-12T22:44:27.129ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ffe707ac-7f49-497d-beef-33098ae2bcc4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27902024-12-12T22:44:27.129ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ffe707ac-7f49-497d-beef-33098ae2bcc4
27912024-12-12T22:44:27.151ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0101354b-4aed-4a3c-aa42-78e2e2510c9b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27922024-12-12T22:44:27.151ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0101354b-4aed-4a3c-aa42-78e2e2510c9b
27932024-12-12T22:44:27.175ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8ec50946-b029-4583-84f3-35d2ce5b9dff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27942024-12-12T22:44:27.175ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8ec50946-b029-4583-84f3-35d2ce5b9dff
27952024-12-12T22:44:27.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215557 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59161 req_id = 8d6bed71-c4c6-47df-a308-cd4d58854cb4 response_code = 200 uri = /inventory
27962024-12-12T22:44:32.199ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6236 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = 3d0d53a9-c481-45b2-b041-3fd144928f69 response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
27972024-12-12T22:44:41.353ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43956
27982024-12-12T22:44:41.353ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43956 req_id = 98548930-8046-4a84-b7a3-4aca0da24c18 response_code = 200 uri = /baseboard
27992024-12-12T22:44:55.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62290
28002024-12-12T22:44:55.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62290 req_id = 78a19a53-d674-4fa5-90dc-a59586d7ac12 response_code = 200 uri = /vpc-routes
28012024-12-12T22:44:55.326ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
28022024-12-12T22:44:55.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62290 req_id = 0d487807-307a-4f89-9dc2-e51d3a102709 response_code = 204 uri = /eip-gateways
28032024-12-12T22:44:55.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62290 req_id = 102a2298-3417-4c09-bbb4-fbb740e615a1 response_code = 204 uri = /vpc-routes
28042024-12-12T22:44:55.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41283
28052024-12-12T22:44:55.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41283 req_id = ba8193fe-8fed-4a40-bc63-ca79aa330aa2 response_code = 200 uri = /v2p
28062024-12-12T22:44:55.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38132
28072024-12-12T22:44:55.455ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28082024-12-12T22:44:55.494ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28092024-12-12T22:44:55.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96069 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38132 req_id = 2e6a0ca0-6bf3-42db-9bd0-4577b7c91518 response_code = 204 uri = /switch-ports
28102024-12-12T22:44:55.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38132 req_id = 5d243764-4a9c-43be-9493-9a43fe862ffc response_code = 200 uri = /network-bootstore-config
28112024-12-12T22:44:56.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43603
28122024-12-12T22:44:56.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43603 req_id = 3dffd964-27d3-4f53-b227-259f3c3a93b3 response_code = 200 uri = /vpc-routes
28132024-12-12T22:44:56.097ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
28142024-12-12T22:44:56.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43603 req_id = dab89447-2aa0-4111-aeaa-4917f243e899 response_code = 204 uri = /eip-gateways
28152024-12-12T22:44:56.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43603 req_id = 877dac3a-0d05-41f6-a813-928a2d880b83 response_code = 204 uri = /vpc-routes
28162024-12-12T22:44:56.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45681
28172024-12-12T22:44:56.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45681 req_id = d9d83c2f-7ba1-4d9f-902f-c55408be5879 response_code = 200 uri = /v2p
28182024-12-12T22:44:56.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44096
28192024-12-12T22:44:56.184ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28202024-12-12T22:44:56.222ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28212024-12-12T22:44:56.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90892 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44096 req_id = 543f3d4a-1896-49ed-a16f-b69e8d7eb680 response_code = 204 uri = /switch-ports
28222024-12-12T22:44:56.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44096 req_id = 3149fb6f-0379-4e25-a9ff-02ab7d4831aa response_code = 200 uri = /network-bootstore-config
28232024-12-12T22:44:56.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58668
28242024-12-12T22:44:56.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58668 req_id = fed52d4c-d263-4576-96cd-149221a5d3b2 response_code = 200 uri = /vpc-routes
28252024-12-12T22:44:56.393ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
28262024-12-12T22:44:56.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58668 req_id = 3ad1a2c8-ca15-4554-8284-2fa4735e10b1 response_code = 204 uri = /eip-gateways
28272024-12-12T22:44:56.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 369 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58668 req_id = ee31cca4-e9b4-4591-bfe8-83e7ad74fbda response_code = 204 uri = /vpc-routes
28282024-12-12T22:44:56.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53435
28292024-12-12T22:44:56.449ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28302024-12-12T22:44:56.489ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28312024-12-12T22:44:56.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96791 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53435 req_id = 83f252d0-73ed-4de5-9289-2ef00f5e2e7c response_code = 204 uri = /switch-ports
28322024-12-12T22:44:56.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51921
28332024-12-12T22:44:56.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53435 req_id = bb89bce9-1b05-43ee-9dbb-636d962f57ae response_code = 200 uri = /network-bootstore-config
28342024-12-12T22:44:56.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51921 req_id = 2e9d702f-1a38-4200-9958-1b955704ba43 response_code = 200 uri = /v2p
28352024-12-12T22:45:02.200ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7679 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = 8a7cd770-f2b1-4b9d-a173-e9d3bdb69ed3 response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
28362024-12-12T22:45:11.384ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44883
28372024-12-12T22:45:11.384ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44883 req_id = 96cffa18-94b3-4230-977e-d8be9b0d2bbc response_code = 200 uri = /baseboard
28382024-12-12T22:45:25.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59982
28392024-12-12T22:45:25.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59982 req_id = 8c0c9c18-211b-406a-a1c0-9335528313f2 response_code = 200 uri = /v2p
28402024-12-12T22:45:25.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41486
28412024-12-12T22:45:25.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41486 req_id = bda061a6-24e9-4815-a5d1-ba32fd1c5d39 response_code = 200 uri = /vpc-routes
28422024-12-12T22:45:25.558ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
28432024-12-12T22:45:25.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41486 req_id = a43bcb9d-e398-4b0e-bc2e-b349afcdb234 response_code = 204 uri = /eip-gateways
28442024-12-12T22:45:25.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35145
28452024-12-12T22:45:25.566ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28462024-12-12T22:45:25.606ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28472024-12-12T22:45:25.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96493 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35145 req_id = f6b1913c-01f1-4172-9961-77f001e98175 response_code = 204 uri = /switch-ports
28482024-12-12T22:45:25.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41486 req_id = 925bc89d-f2fb-458f-87a9-d04cfac079a9 response_code = 204 uri = /vpc-routes
28492024-12-12T22:45:25.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35145 req_id = 1147c4ec-dc87-48cc-8985-ed7539d1ce59 response_code = 200 uri = /network-bootstore-config
28502024-12-12T22:45:25.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59140
28512024-12-12T22:45:25.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59140 req_id = 5970ea30-1819-4757-a28a-e5a9d9fe097a response_code = 200 uri = /vpc-routes
28522024-12-12T22:45:26.060ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
28532024-12-12T22:45:26.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59140 req_id = 19a808d9-beee-4993-8764-4939bf10bf56 response_code = 204 uri = /eip-gateways
28542024-12-12T22:45:26.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59140 req_id = c4998d77-4d64-42f6-adda-b81a8aad9b77 response_code = 204 uri = /vpc-routes
28552024-12-12T22:45:26.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54495
28562024-12-12T22:45:26.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54495 req_id = ef10d320-e616-49c6-a640-1da6ecb7892a response_code = 200 uri = /v2p
28572024-12-12T22:45:26.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53926
28582024-12-12T22:45:26.327ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28592024-12-12T22:45:26.366ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28602024-12-12T22:45:26.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92627 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53926 req_id = b7357d0e-5ea7-4d48-96f5-2e67b92a93de response_code = 204 uri = /switch-ports
28612024-12-12T22:45:26.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53926 req_id = 58751eee-b3f2-4591-982f-f83359c2d48b response_code = 200 uri = /network-bootstore-config
28622024-12-12T22:45:26.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42374
28632024-12-12T22:45:26.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42374 req_id = 647eaec7-4d4f-44c0-a853-e3f0109306fa response_code = 200 uri = /vpc-routes
28642024-12-12T22:45:26.477ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
28652024-12-12T22:45:26.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42374 req_id = e2bfc17e-e4fd-499f-9a2b-6e0f3b5c082e response_code = 204 uri = /eip-gateways
28662024-12-12T22:45:26.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42945
28672024-12-12T22:45:26.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42945 req_id = 95b280d6-f287-4533-8900-2c49aaeefd7a response_code = 200 uri = /v2p
28682024-12-12T22:45:26.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42374 req_id = 07b6730d-9de7-493d-b6c0-debb6d38c7b2 response_code = 204 uri = /vpc-routes
28692024-12-12T22:45:26.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64319
28702024-12-12T22:45:26.625ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28712024-12-12T22:45:26.663ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28722024-12-12T22:45:26.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92426 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64319 req_id = c92f32a2-6848-4768-a76f-0e0b2211e09c response_code = 204 uri = /switch-ports
28732024-12-12T22:45:26.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64319 req_id = f06bb025-871d-47a5-ac9d-49be40453521 response_code = 200 uri = /network-bootstore-config
28742024-12-12T22:45:32.200ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7531 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = f75490de-8f84-4659-9cd9-3f829335bc6f response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
28752024-12-12T22:45:41.417ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41270
28762024-12-12T22:45:41.417ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41270 req_id = cad4d54b-9be2-4b6f-a907-1d19cb29f6ef response_code = 200 uri = /baseboard
28772024-12-12T22:45:55.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42490
28782024-12-12T22:45:55.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42490 req_id = 6ab6dc40-4223-48d9-9f40-13742a9ca26b response_code = 200 uri = /vpc-routes
28792024-12-12T22:45:55.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54287
28802024-12-12T22:45:55.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54287 req_id = 686d7f2e-47f0-4e36-9988-d2fbbadcb643 response_code = 200 uri = /v2p
28812024-12-12T22:45:55.444ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
28822024-12-12T22:45:55.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42490 req_id = 5d4297f4-f90b-4c77-9648-68522458fd26 response_code = 204 uri = /eip-gateways
28832024-12-12T22:45:55.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42490 req_id = b6f2001a-6667-43a1-befc-f7f33ed131b6 response_code = 204 uri = /vpc-routes
28842024-12-12T22:45:55.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35800
28852024-12-12T22:45:55.517ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28862024-12-12T22:45:55.557ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28872024-12-12T22:45:55.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97198 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35800 req_id = 2e42d59b-0677-4139-9d33-9779960220b2 response_code = 204 uri = /switch-ports
28882024-12-12T22:45:55.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35800 req_id = 26084ece-e171-4dfe-818a-03d449116b8a response_code = 200 uri = /network-bootstore-config
28892024-12-12T22:45:56.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45400
28902024-12-12T22:45:56.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45400 req_id = 3fcc1b29-1474-4c7e-8370-9cc4d2dd7c0e response_code = 200 uri = /vpc-routes
28912024-12-12T22:45:56.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36019
28922024-12-12T22:45:56.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36019 req_id = 3981bbdc-3ee3-49dd-914b-38d4fb5b08a8 response_code = 200 uri = /v2p
28932024-12-12T22:45:56.075ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
28942024-12-12T22:45:56.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45400 req_id = 71144481-01f4-45ed-bd6f-67a30e287bc4 response_code = 204 uri = /eip-gateways
28952024-12-12T22:45:56.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45400 req_id = 4567fdc1-18ee-486f-93ce-7d684a37d2cb response_code = 204 uri = /vpc-routes
28962024-12-12T22:45:56.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45537
28972024-12-12T22:45:56.203ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28982024-12-12T22:45:56.245ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28992024-12-12T22:45:56.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109840 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45537 req_id = 664ef94c-9e0e-4af0-9043-4d6194ee57f1 response_code = 204 uri = /switch-ports
29002024-12-12T22:45:56.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34116
29012024-12-12T22:45:56.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45537 req_id = be94308d-358d-4978-bd0a-2efb88a16b90 response_code = 200 uri = /network-bootstore-config
29022024-12-12T22:45:56.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34116 req_id = fcf62978-544a-484e-9b66-64cb09cc9a0b response_code = 200 uri = /vpc-routes
29032024-12-12T22:45:56.359ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
29042024-12-12T22:45:56.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34116 req_id = 7a483dae-3194-4d89-86f4-b237fd3b4b27 response_code = 204 uri = /eip-gateways
29052024-12-12T22:45:56.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34116 req_id = 56264156-7b75-4fff-974a-1e5105180bbb response_code = 204 uri = /vpc-routes
29062024-12-12T22:45:56.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43230
29072024-12-12T22:45:56.394ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29082024-12-12T22:45:56.439ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29092024-12-12T22:45:56.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116519 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43230 req_id = b1b19e54-a14a-4e96-a3b0-cd0b5920f144 response_code = 204 uri = /switch-ports
29102024-12-12T22:45:56.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48514
29112024-12-12T22:45:56.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48514 req_id = 4edc9ef0-2eab-4fa1-99b0-776a416596b2 response_code = 200 uri = /v2p
29122024-12-12T22:45:56.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43230 req_id = 22a78993-514e-44aa-9564-3b54d48aae96 response_code = 200 uri = /network-bootstore-config
29132024-12-12T22:46:00.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40421
29142024-12-12T22:46:00.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40421 req_id = a9329b43-a073-44c5-a52f-e78c3950a1b4 response_code = 200 uri = /v2p
29152024-12-12T22:46:00.593ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(6687827) }
29162024-12-12T22:46:00.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 649 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40421 req_id = 6b7d66d8-b83f-49ae-8af4-408650cf9e1b response_code = 204 uri = /v2p
29172024-12-12T22:46:00.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36486
29182024-12-12T22:46:00.800ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e2f6b500-76a5-477a-9458-d2a61cf87fe0, kind: Instance { id: 75c5c625-d23a-427a-ac91-ec3503339289 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6687827), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e2f6b500-76a5-477a-9458-d2a61cf87fe0, kind: Instance { id: 75c5c625-d23a-427a-ac91-ec3503339289 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6687827), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e2f6b500-76a5-477a-9458-d2a61cf87fe0, kind: Instance { id: 75c5c625-d23a-427a-ac91-ec3503339289 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6687827), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6687827))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e2f6b500-76a5-477a-9458-d2a61cf87fe0, kind: Instance { id: 75c5c625-d23a-427a-ac91-ec3503339289 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6687827), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-664a2a7f94a", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 0148e9fc-15b3-41dd-ad04-102e65b4ea9e, read_only_parent: Some(Volume { block_size: 512, id: e8205ba4-5daf-4d45-bd0e-ae920eee7bdc, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 9930b0ee-a30e-49da-815d-52383d9c9a98, key: Some("jq3Svhov6V34gR9Mf5XYi/Fjors5CDev6cTbXoa5c2o="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 0148e9fc-15b3-41dd-ad04-102e65b4ea9e, key: Some("TsTF8n41Cl1Q9P/NtfIq5W08A30mi3FvIJFLZKvgXIE="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::1a]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-664a2a7f94a" }] }), cloud_init_bytes: Some(..) } instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 metadata = InstanceMetadata { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, project_id: ebb9888c-6895-42ab-9270-4054c8bf11cd } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-12T22:46:00.794837336Z }
29192024-12-12T22:46:00.800ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 migration_id = None propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29202024-12-12T22:46:00.800ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 migration_id = None propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e2f6b500-76a5-477a-9458-d2a61cf87fe0, kind: Instance { id: 75c5c625-d23a-427a-ac91-ec3503339289 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6687827), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e2f6b500-76a5-477a-9458-d2a61cf87fe0, kind: Instance { id: 75c5c625-d23a-427a-ac91-ec3503339289 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6687827), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e2f6b500-76a5-477a-9458-d2a61cf87fe0, kind: Instance { id: 75c5c625-d23a-427a-ac91-ec3503339289 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6687827), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6687827))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e2f6b500-76a5-477a-9458-d2a61cf87fe0, kind: Instance { id: 75c5c625-d23a-427a-ac91-ec3503339289 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6687827), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-664a2a7f94a", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 0148e9fc-15b3-41dd-ad04-102e65b4ea9e, read_only_parent: Some(Volume { block_size: 512, id: e8205ba4-5daf-4d45-bd0e-ae920eee7bdc, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 9930b0ee-a30e-49da-815d-52383d9c9a98, key: Some("jq3Svhov6V34gR9Mf5XYi/Fjors5CDev6cTbXoa5c2o="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 0148e9fc-15b3-41dd-ad04-102e65b4ea9e, key: Some("TsTF8n41Cl1Q9P/NtfIq5W08A30mi3FvIJFLZKvgXIE="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::1a]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-664a2a7f94a" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-12T22:46:00.794837336Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29212024-12-12T22:46:00.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36486 req_id = 224a544a-1031-4bf8-b99a-55925d4833b2 response_code = 200 uri = /vmms/0baee8a6-8e6b-4e49-992a-df5f1aa40263
29222024-12-12T22:46:00.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50198
29232024-12-12T22:46:00.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50198 req_id = f259083b-c1b1-4102-8276-a02ff8f8c62b response_code = 200 uri = /vmms/0baee8a6-8e6b-4e49-992a-df5f1aa40263/state
29242024-12-12T22:46:00.912ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 6687827 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29252024-12-12T22:46:00.912ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29262024-12-12T22:46:00.950ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263 file = illumos-utils/src/zone.rs:325 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29272024-12-12T22:46:00.974ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263 file = illumos-utils/src/zone.rs:363 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29282024-12-12T22:46:00.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58638
29292024-12-12T22:46:00.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58638 req_id = b744f2a9-a63c-4ccb-9ffa-d0563b0db727 response_code = 200 uri = /vpc-routes
29302024-12-12T22:46:01.012ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {e2f6b500-76a5-477a-9458-d2a61cf87fe0: {10.151.2.175: {3bf921b4-d329-4cec-9339-6741e23d494f}, 10.151.2.176: {3bf921b4-d329-4cec-9339-6741e23d494f}}} }
29312024-12-12T22:46:02.200ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7479 local_addr = [fd00:1122:3344:101::1]:56260 method = GET remote_addr = [fd00:1122:3344:101::d]:38061 req_id = f1c63fb9-0222-41ce-be53-cae2822c96fc response_code = 200 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 uri = /4a8c9490-d35a-4221-8585-e4103b325118
29322024-12-12T22:46:02.412ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
29332024-12-12T22:46:02.562ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29342024-12-12T22:46:02.562ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 zone = oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263
29352024-12-12T22:46:02.740ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263") failed: Property not found. retry in 73.010938ms file = illumos-utils/src/svc.rs:36 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 zone = oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263
29362024-12-12T22:46:02.830ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263") failed: Property not found. retry in 89.910036ms file = illumos-utils/src/svc.rs:36 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 zone = oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263
29372024-12-12T22:46:02.936ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263") failed: Property not found. retry in 202.652246ms file = illumos-utils/src/svc.rs:36 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 zone = oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263
29382024-12-12T22:46:03.151ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263") failed: Property not found. retry in 399.225608ms file = illumos-utils/src/svc.rs:36 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 zone = oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263
29392024-12-12T22:46:03.564ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263") failed: Property not found. retry in 657.42374ms file = illumos-utils/src/svc.rs:36 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 zone = oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263
29402024-12-12T22:46:04.234ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263") failed: Property not found. retry in 646.643225ms file = illumos-utils/src/svc.rs:36 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 zone = oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263
29412024-12-12T22:46:04.892ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263") failed: Property not found. retry in 955.71222ms file = illumos-utils/src/svc.rs:36 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 zone = oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263
29422024-12-12T22:46:05.859ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263") failed: Property not found. retry in 1.1024325s file = illumos-utils/src/svc.rs:36 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 zone = oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263
29432024-12-12T22:46:06.974ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263") failed: Property not found. retry in 1.099994453s file = illumos-utils/src/svc.rs:36 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 zone = oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263
29442024-12-12T22:46:08.102ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263 file = sled-agent/src/instance.rs:1786 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29452024-12-12T22:46:08.111ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263") failed: Property not found. retry in 30.498155ms file = illumos-utils/src/svc.rs:36 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29462024-12-12T22:46:08.152ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263") failed: Property not found. retry in 91.789903ms file = illumos-utils/src/svc.rs:36 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29472024-12-12T22:46:08.254ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29482024-12-12T22:46:08.293ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29492024-12-12T22:46:08.430ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29502024-12-12T22:46:08.432ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
29512024-12-12T22:46:08.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7420428 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58638 req_id = 0eb523ca-4055-4d18-bc1f-d27a92d838d8 response_code = 204 uri = /eip-gateways
29522024-12-12T22:46:08.433ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-12T22:46:08.432464598Z } file = sled-agent/src/instance.rs:780 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29532024-12-12T22:46:08.433ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-12T22:46:08.432464598Z } propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29542024-12-12T22:46:08.434ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-12T22:46:08.432464598Z }, migration_in: None, migration_out: None }
29552024-12-12T22:46:08.456ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-12T22:46:08.456088402Z } file = sled-agent/src/instance.rs:780 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29562024-12-12T22:46:08.456ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-12T22:46:08.456088402Z } propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29572024-12-12T22:46:08.456ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-12T22:46:08.456088402Z }, migration_in: None, migration_out: None }
29582024-12-12T22:46:08.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 388 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58638 req_id = af315d3e-9fd6-4f89-a5b7-5ca2037a86bb response_code = 204 uri = /vpc-routes
29592024-12-12T22:46:11.450ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64982
29602024-12-12T22:46:11.450ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64982 req_id = b92c4c05-22ea-4727-9e50-77be805e327c response_code = 200 uri = /baseboard
29612024-12-12T22:46:18.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56701
29622024-12-12T22:46:18.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 539 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56701 req_id = 6786fb1f-6841-422f-9a25-2037d2369e2c response_code = 200 uri = /vmms/0baee8a6-8e6b-4e49-992a-df5f1aa40263/state
29632024-12-12T22:46:18.464ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-12T22:46:18.464572456Z } file = sled-agent/src/instance.rs:780 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29642024-12-12T22:46:18.464ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-12T22:46:18.464572456Z } propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29652024-12-12T22:46:18.464ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-12T22:46:18.464572456Z }, migration_in: None, migration_out: None }
29662024-12-12T22:46:18.479ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-12T22:46:18.479484439Z } file = sled-agent/src/instance.rs:780 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29672024-12-12T22:46:18.479ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-12T22:46:18.479484439Z } propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29682024-12-12T22:46:18.479ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29692024-12-12T22:46:18.480ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29702024-12-12T22:46:18.480ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29712024-12-12T22:46:18.481ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/5119dcd2-c20b-49c6-bcd2-5936df3c4a7b/debug/bundle/zone", "/pool/int/e961868f-b7f7-4714-8a9f-9bb5fb9fe86d/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/64cf57bb-ed1f-48c4-915e-9b1967f8e7d7/crypt/debug", "/pool/ext/93ec67c2-740c-41e9-a5e6-8ae9202a7908/crypt/debug", "/pool/ext/662d717a-a0c0-4538-854a-f7813f739fb9/crypt/debug", "/pool/ext/06e7bad6-773d-4089-9ade-6e4f457beccc/crypt/debug", "/pool/ext/8146c792-6a91-4f87-a5d5-73980d0b7ba5/crypt/debug", "/pool/ext/3c596d62-0729-49f7-ab54-437e3babc937/crypt/debug", "/pool/ext/ffe707ac-7f49-497d-beef-33098ae2bcc4/crypt/debug", "/pool/ext/0101354b-4aed-4a3c-aa42-78e2e2510c9b/crypt/debug", "/pool/ext/8ec50946-b029-4583-84f3-35d2ce5b9dff/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263
29722024-12-12T22:46:18.481ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 11170174041489759674 n_samples = 6 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
29732024-12-12T22:46:18.481ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 5659679624666436052 n_samples = 6 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
29742024-12-12T22:46:19.115ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263", bundle_id: b232116b-8899-44d8-8aea-74d7385fdbf4 }, time_created: 2024-12-12T22:46:18.481632261Z, version: 0, cause: TerminatedInstance }
29752024-12-12T22:46:19.115ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_0baee8a6-8e6b-4e49-992a-df5f1aa40263 file = sled-agent/src/instance.rs:1032 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29762024-12-12T22:46:20.859ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29772024-12-12T22:46:20.876ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(6687827), kind: System }
29782024-12-12T22:46:20.876ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(6687827), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
29792024-12-12T22:46:20.876ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-12T22:46:20.876745161Z }, migration_in: None, migration_out: None }
29802024-12-12T22:46:20.902ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-12T22:46:20.876745161Z }, migration_in: None, migration_out: None }
29812024-12-12T22:46:20.914ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 75c5c625-d23a-427a-ac91-ec3503339289 propolis_id = 0baee8a6-8e6b-4e49-992a-df5f1aa40263
29822024-12-12T22:46:21.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49733
29832024-12-12T22:46:21.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49733 req_id = 12feb518-68f0-440a-8e24-32ffa41ebf58 response_code = 200 uri = /vpc-routes
29842024-12-12T22:46:21.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38841
29852024-12-12T22:46:21.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38841 req_id = 03151122-4ba8-4205-8b66-c84fa8e7bb8f response_code = 200 uri = /v2p
29862024-12-12T22:46:21.342ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
29872024-12-12T22:46:21.342ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118
29882024-12-12T22:46:21.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49733 req_id = 205176bd-6c0b-412b-9a90-6ef522ce2565 response_code = 204 uri = /eip-gateways
29892024-12-12T22:46:21.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49733 req_id = a19d51c3-a417-45ec-9576-add06ea096c1 response_code = 204 uri = /vpc-routes
29902024-12-12T22:46:21.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45786
29912024-12-12T22:46:21.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45786 req_id = a88d7dc2-5bc5-43aa-97bb-bf2f3e779d79 response_code = 200 uri = /v2p
29922024-12-12T22:46:21.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50176
29932024-12-12T22:46:21.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50176 req_id = cdb6e67e-6336-4216-9ea1-db69ac257bfe response_code = 200 uri = /vpc-routes
29942024-12-12T22:46:21.586ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
29952024-12-12T22:46:21.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50176 req_id = c9189bcd-de37-40a0-a87e-91a22510fd1f response_code = 204 uri = /eip-gateways
29962024-12-12T22:46:21.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50176 req_id = f78d7599-88ae-4447-8caf-f3e992ac23f4 response_code = 204 uri = /vpc-routes
29972024-12-12T22:46:22.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57270
29982024-12-12T22:46:22.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57270 req_id = 6eb20b8c-261a-4153-8583-c120359453b6 response_code = 200 uri = /vpc-routes
29992024-12-12T22:46:22.176ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 4a8c9490-d35a-4221-8585-e4103b325118 values = ExternalIpGatewayMap { mappings: {} }
30002024-12-12T22:46:22.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57270 req_id = abd6a70d-a3c0-4c0e-ada1-69af07a5765e response_code = 204 uri = /eip-gateways
30012024-12-12T22:46:22.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57270 req_id = 98c3a499-6470-444a-b609-84726792e1bc response_code = 204 uri = /vpc-routes