Max level shown:
1 [ Nov 19 19:36:38 Enabled. ]
2 [ Nov 19 19:36:38 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 19 19:36:38 Method "start" exited with status 0. ]
4 [ Nov 19 19:36:38 Rereading configuration. ]
5 [ Nov 19 19:36:38 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-19T19:36:38.492ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-19T19:36:38.492ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-19T19:36:38.544ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-19T19:36:38.544ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-19T19:36:38.658ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-19T19:36:38.667ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-19T19:36:38.675ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-19T19:36:39.275ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-11-19T19:36:39.413ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-19T19:36:39.414ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-19T19:36:39.414ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-19T19:36:39.414ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-19T19:36:39.414ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-19T19:36:39.414ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-19T19:36:39.417ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-19T19:36:39.417ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-19T19:36:39.417ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-19T19:36:39.417ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-19T19:36:39.417ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-19T19:36:39.417ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-19T19:36:39.417ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-19T19:36:39.417ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-19T19:36:39.417ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-19T19:36:39.428ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-19T19:36:39.428ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = fbc1611e-058f-49c8-948e-b1a1af061463 (zpool)
322024-11-19T19:36:39.526ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fbc1611e-058f-49c8-948e-b1a1af061463 (zpool), kind: Internal }
332024-11-19T19:36:39.999ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-19T19:36:39.999ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-19T19:36:39.999ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-19T19:36:39.999ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-19T19:36:39.999ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-19T19:36:39.999ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-19T19:36:39.999ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-19T19:36:40.008ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-19T19:36:40.008ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = d3dd1034-4279-4c8b-a3e7-e06018ad7ea1 (zpool)
422024-11-19T19:36:40.097ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d3dd1034-4279-4c8b-a3e7-e06018ad7ea1 (zpool), kind: Internal }
432024-11-19T19:36:40.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-19T19:36:40.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fbc1611e-058f-49c8-948e-b1a1af061463 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d3dd1034-4279-4c8b-a3e7-e06018ad7ea1 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-19T19:36:40.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-19T19:36:40.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-11-19T19:36:40.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-11-19T19:36:40.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-19T19:36:40.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-19T19:36:40.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fbc1611e-058f-49c8-948e-b1a1af061463 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d3dd1034-4279-4c8b-a3e7-e06018ad7ea1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-19T19:36:40.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-11-19T19:36:40.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-11-19T19:36:40.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
542024-11-19T19:36:40.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-11-19T19:36:40.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-19T19:36:40.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572024-11-19T19:36:40.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fbc1611e-058f-49c8-948e-b1a1af061463 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d3dd1034-4279-4c8b-a3e7-e06018ad7ea1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-11-19T19:36:40.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-11-19T19:36:40.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-11-19T19:36:40.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-11-19T19:36:40.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fbc1611e-058f-49c8-948e-b1a1af061463 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d3dd1034-4279-4c8b-a3e7-e06018ad7ea1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
622024-11-19T19:36:40.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
632024-11-19T19:36:40.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-11-19T19:36:40.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652024-11-19T19:36:40.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
662024-11-19T19:36:40.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-11-19T19:36:40.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-19T19:36:40.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fbc1611e-058f-49c8-948e-b1a1af061463 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d3dd1034-4279-4c8b-a3e7-e06018ad7ea1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-19T19:36:40.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-19T19:36:40.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-19T19:36:40.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-11-19T19:36:40.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-19T19:36:40.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-19T19:36:40.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fbc1611e-058f-49c8-948e-b1a1af061463 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d3dd1034-4279-4c8b-a3e7-e06018ad7ea1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-19T19:36:40.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-19T19:36:40.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-19T19:36:40.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-11-19T19:36:40.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-19T19:36:40.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-19T19:36:40.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-11-19T19:36:40.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-11-19T19:36:40.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fbc1611e-058f-49c8-948e-b1a1af061463 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d3dd1034-4279-4c8b-a3e7-e06018ad7ea1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-11-19T19:36:40.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
842024-11-19T19:36:40.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
852024-11-19T19:36:40.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
862024-11-19T19:36:40.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-11-19T19:36:40.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-11-19T19:36:40.581ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
892024-11-19T19:36:40.581ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
902024-11-19T19:36:40.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fbc1611e-058f-49c8-948e-b1a1af061463 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d3dd1034-4279-4c8b-a3e7-e06018ad7ea1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
912024-11-19T19:36:40.581ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
922024-11-19T19:36:40.581ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
932024-11-19T19:36:40.581ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
942024-11-19T19:36:40.581ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
952024-11-19T19:36:40.581ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fbc1611e-058f-49c8-948e-b1a1af061463 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d3dd1034-4279-4c8b-a3e7-e06018ad7ea1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
962024-11-19T19:36:40.582ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
972024-11-19T19:36:40.582ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
982024-11-19T19:36:40.582ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-19T19:36:40.582ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1002024-11-19T19:36:40.582ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fbc1611e-058f-49c8-948e-b1a1af061463 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d3dd1034-4279-4c8b-a3e7-e06018ad7ea1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012024-11-19T19:36:40.582ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-11-19T19:36:40.582ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032024-11-19T19:36:40.582ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-19T19:36:40.582ZINFOSledAgent (bootstore): No ledger in /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1052024-11-19T19:36:40.582ZINFOSledAgent (bootstore): No ledger in /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1062024-11-19T19:36:40.582ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-11-19T19:36:40.582ZINFOSledAgent (bootstore): No ledger in /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/cluster/bootstore-network-config.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1082024-11-19T19:36:40.582ZINFOSledAgent (bootstore): No ledger in /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/cluster/bootstore-network-config.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1092024-11-19T19:36:40.582ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-11-19T19:36:40.582ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-19T19:36:40.582ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-19T19:36:40.593ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:743
1132024-11-19T19:36:40.593ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2127, tv_nsec: 720988103 } time_to_next_cleanup = 599.999915478s
1142024-11-19T19:36:40.593ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4005
1152024-11-19T19:36:40.593ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-19T19:36:40.595ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/sled-agent-request.json file = common/src/ledger.rs:189
1172024-11-19T19:36:40.595ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/sled-agent-request.json file = common/src/ledger.rs:189
1182024-11-19T19:36:40.596ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-11-19T19:36:40.598ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-11-19T19:36:40.598ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1200
1212024-11-19T19:36:40.598ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-19T19:36:40.598ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-19T19:36:40.598ZINFOSledAgent (RSS): No ledger in /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/rss-plan-completed.marker file = common/src/ledger.rs:189
1242024-11-19T19:36:40.598ZINFOSledAgent (RSS): No ledger in /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/rss-plan-completed.marker file = common/src/ledger.rs:189
1252024-11-19T19:36:40.598ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1263
1262024-11-19T19:36:40.598ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-19T19:36:40.598ZINFOSledAgent (RSS): No ledger in /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/rss-sled-plan.json file = common/src/ledger.rs:189
1282024-11-19T19:36:40.598ZINFOSledAgent (RSS): No ledger in /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/rss-sled-plan.json file = common/src/ledger.rs:189
1292024-11-19T19:36:40.598ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1305
1302024-11-19T19:36:40.598ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-19T19:36:40.598ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-19T19:36:40.598ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-19T19:36:40.598ZINFOSledAgent (RSS): Writing ledger to /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:200
1342024-11-19T19:36:40.599ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/rss-sled-plan.json"
1352024-11-19T19:36:40.599ZINFOSledAgent (RSS): Writing ledger to /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:200
1362024-11-19T19:36:40.599ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/rss-sled-plan.json"
1372024-11-19T19:36:40.599ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 479337c4-04f4-4e7a-9efb-a08d086d843e, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 367f799f-31b8-4d9a-a686-ab6e465d52be (sled), rack_id: 479337c4-04f4-4e7a-9efb-a08d086d843e, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1382024-11-19T19:36:40.599ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1339
1392024-11-19T19:36:40.599ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1402024-11-19T19:36:40.599ZINFOSledAgent (bootstore): Writing ledger to /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
1412024-11-19T19:36:40.599ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
1422024-11-19T19:36:40.599ZINFOSledAgent (bootstore): Writing ledger to /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
1432024-11-19T19:36:40.599ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
1442024-11-19T19:36:40.599ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1452024-11-19T19:36:40.599ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 367f799f-31b8-4d9a-a686-ab6e465d52be (sled), rack_id: 479337c4-04f4-4e7a-9efb-a08d086d843e, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1462024-11-19T19:36:40.600ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4302
1472024-11-19T19:36:40.600ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4702
1482024-11-19T19:36:40.605ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1492024-11-19T19:36:40.610ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1502024-11-19T19:36:40.610ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1512024-11-19T19:36:40.615ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1522024-11-19T19:36:40.615ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1532024-11-19T19:36:40.615ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:34477
1542024-11-19T19:36:40.615ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 367f799f-31b8-4d9a-a686-ab6e465d52be (sled), rack_id: 479337c4-04f4-4e7a-9efb-a08d086d843e, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1552024-11-19T19:36:40.615ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1562024-11-19T19:36:40.615ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1572024-11-19T19:36:40.615ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1582024-11-19T19:36:40.615ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1592024-11-19T19:36:40.615ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1602024-11-19T19:36:40.615ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1612024-11-19T19:36:40.615ZINFOSledAgent (StorageManager): No ledger in /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = load_disks_ledger
1622024-11-19T19:36:40.615ZINFOSledAgent (StorageManager): No ledger in /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = load_disks_ledger
1632024-11-19T19:36:40.615ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1642024-11-19T19:36:40.615ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1652024-11-19T19:36:40.615ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1662024-11-19T19:36:40.615ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1672024-11-19T19:36:40.615ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1682024-11-19T19:36:40.631ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-19T19:36:40.652ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1702024-11-19T19:36:40.669ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1712024-11-19T19:36:40.678ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:407 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
1722024-11-19T19:36:40.678ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1732024-11-19T19:36:40.678ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:419 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
1742024-11-19T19:36:40.678ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1752024-11-19T19:36:40.681ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 101.337561ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c28f2f62-fc65-40d7-851d-7e72525bba5c", "content-length": "124", "date": "Tue, 19 Nov 2024 19:36:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c28f2f62-fc65-40d7-851d-7e72525bba5c" } file = clients/ddm-admin-client/src/lib.rs:177
1762024-11-19T19:36:40.692ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_fbc1611e-058f-49c8-948e-b1a1af061463/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1772024-11-19T19:36:40.715ZINFOSledAgent: successfully created encrypted zvol: name="oxi_fbc1611e-058f-49c8-948e-b1a1af061463/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1782024-11-19T19:36:40.715ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_fbc1611e-058f-49c8-948e-b1a1af061463/swap" file = sled-agent/src/swap_device.rs:96
1792024-11-19T19:36:40.720ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:434 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
1802024-11-19T19:36:40.720ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1812024-11-19T19:36:40.720ZINFOSledAgent (BackingFs): Ensuring dataset oxi_fbc1611e-058f-49c8-948e-b1a1af061463/backing/fmd file = sled-agent/src/backing_fs.rs:138
1822024-11-19T19:36:40.784ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1832024-11-19T19:36:40.784ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 167.269051ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7e044386-1282-41dc-9a0e-c6315505f32f", "content-length": "124", "date": "Tue, 19 Nov 2024 19:36:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7e044386-1282-41dc-9a0e-c6315505f32f" } file = clients/ddm-admin-client/src/lib.rs:177
1842024-11-19T19:36:40.816ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1852024-11-19T19:36:40.953ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862024-11-19T19:36:40.953ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 151.994899ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ceb04b58-ee1d-427b-b7bf-83696e78dfb8", "content-length": "124", "date": "Tue, 19 Nov 2024 19:36:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ceb04b58-ee1d-427b-b7bf-83696e78dfb8" } file = clients/ddm-admin-client/src/lib.rs:177
1872024-11-19T19:36:41.035ZINFOSledAgent (BackingFs): Mounting oxi_fbc1611e-058f-49c8-948e-b1a1af061463/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1882024-11-19T19:36:41.048ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1892024-11-19T19:36:41.048ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1902024-11-19T19:36:41.048ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1912024-11-19T19:36:41.048ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1922024-11-19T19:36:41.106ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-19T19:36:41.107ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 171.014406ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3848ddd1-fd2b-4f35-9add-58fd396fdab0", "content-length": "124", "date": "Tue, 19 Nov 2024 19:36:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3848ddd1-fd2b-4f35-9add-58fd396fdab0" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-19T19:36:41.280ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-19T19:36:41.282ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 267.964364ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c7eeb4e3-d4e6-4c32-b590-6f2c6aa83673", "content-length": "124", "date": "Tue, 19 Nov 2024 19:36:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c7eeb4e3-d4e6-4c32-b590-6f2c6aa83673" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-19T19:36:41.551ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1972024-11-19T19:36:41.552ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 252.226369ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8644805c-8706-468c-80cd-e236832dd901", "content-length": "124", "date": "Tue, 19 Nov 2024 19:36:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8644805c-8706-468c-80cd-e236832dd901" } file = clients/ddm-admin-client/src/lib.rs:177
1982024-11-19T19:36:41.786ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
1992024-11-19T19:36:41.791ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:51326 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2002024-11-19T19:36:41.792ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2012024-11-19T19:36:41.792ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:51326 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 367f799f-31b8-4d9a-a686-ab6e465d52be sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2022024-11-19T19:36:41.793ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 168.173162ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2032024-11-19T19:36:41.794ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2042024-11-19T19:36:41.794ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2052024-11-19T19:36:41.794ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:927 underlay_address = fd00:1122:3344:101::1
2062024-11-19T19:36:41.794ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2072024-11-19T19:36:41.805ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2082024-11-19T19:36:41.963ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 584.926795ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2092024-11-19T19:36:42.548ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.363922303s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2102024-11-19T19:36:43.913ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.431803972s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2112024-11-19T19:36:44.353ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2676
2122024-11-19T19:36:44.353ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2921
2132024-11-19T19:36:44.353ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2546
2142024-11-19T19:36:44.353ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2593
2152024-11-19T19:36:44.353ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3002
2162024-11-19T19:36:44.353ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3047
2172024-11-19T19:36:44.355ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2846
2182024-11-19T19:36:44.357ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2587
2192024-11-19T19:36:44.357ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='2dca9138-6bee-47df-9162-45bafc1cb038'/> <propval type="astring" name="rack_id" value='479337c4-04f4-4e7a-9efb-a08d086d843e'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:feed:9a06'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='479337c4-04f4-4e7a-9efb-a08d086d843e'/> <propval type="astring" name="sled_id" value='367f799f-31b8-4d9a-a686-ab6e465d52be'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='367f799f-31b8-4d9a-a686-ab6e465d52be'/> <propval type="astring" name="rack_uuid" value='479337c4-04f4-4e7a-9efb-a08d086d843e'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='367f799f-31b8-4d9a-a686-ab6e465d52be'/> <propval type="astring" name="rack_uuid" value='479337c4-04f4-4e7a-9efb-a08d086d843e'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2202024-11-19T19:36:44.357ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2212024-11-19T19:36:44.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 47.715424ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-19T19:36:44.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 143.701683ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-19T19:36:44.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 259.003557ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-19T19:36:45.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 525.297079ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-19T19:36:46.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 682.888287ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-19T19:36:46.347ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.409008968s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2272024-11-19T19:36:46.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.16580497s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-11-19T19:36:48.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.414650953s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-19T19:36:49.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 910.013808ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2302024-11-19T19:36:50.842ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/nexus.rs:527 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2312024-11-19T19:36:50.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2322024-11-19T19:36:50.873ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2332024-11-19T19:36:50.874ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2342024-11-19T19:36:50.874ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2352024-11-19T19:36:50.874ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2362024-11-19T19:36:50.874ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:200
2372024-11-19T19:36:50.874ZINFOSledAgent (SledAgentMain): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/sled-agent-request.json"
2382024-11-19T19:36:50.874ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:200
2392024-11-19T19:36:50.874ZINFOSledAgent (SledAgentMain): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/sled-agent-request.json"
2402024-11-19T19:36:50.874ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2412024-11-19T19:36:50.874ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2422024-11-19T19:36:50.874ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4005
2432024-11-19T19:36:50.874ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:34477
2442024-11-19T19:36:51.054ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2452024-11-19T19:36:51.054ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2462024-11-19T19:36:51.055ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2472024-11-19T19:36:51.055ZINFOSledAgent (RSS): No ledger in /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/rss-service-plan-v5.json file = common/src/ledger.rs:189
2482024-11-19T19:36:51.055ZINFOSledAgent (RSS): No ledger in /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/rss-service-plan-v5.json file = common/src/ledger.rs:189
2492024-11-19T19:36:51.055ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2502024-11-19T19:36:51.055ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2512024-11-19T19:36:51.055ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2522024-11-19T19:36:51.055ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2532024-11-19T19:36:51.059ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4326 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2542024-11-19T19:36:51.059ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4342
2552024-11-19T19:36:51.059ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2562024-11-19T19:36:51.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36832
2572024-11-19T19:36:51.339ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2582024-11-19T19:36:51.339ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2592024-11-19T19:36:51.339ZINFOSledAgent (ServiceManager): No ledger in /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json file = common/src/ledger.rs:189
2602024-11-19T19:36:51.339ZINFOSledAgent (ServiceManager): No ledger in /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json file = common/src/ledger.rs:189
2612024-11-19T19:36:51.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36832 req_id = b934e1d9-2dd1-446e-a621-31ef3863967b response_code = 200 uri = /inventory
2622024-11-19T19:36:51.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41355
2632024-11-19T19:36:51.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41355 req_id = 289640e3-2a22-4eaf-889c-abcf477b5d76 response_code = 200 uri = /sled-role
2642024-11-19T19:36:51.370ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2652024-11-19T19:36:51.371ZINFOSledAgent (RSS): Writing ledger to /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:200
2662024-11-19T19:36:51.371ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/rss-service-plan-v5.json"
2672024-11-19T19:36:51.371ZINFOSledAgent (RSS): Writing ledger to /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:200
2682024-11-19T19:36:51.371ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/rss-service-plan-v5.json"
2692024-11-19T19:36:51.371ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2702024-11-19T19:36:51.403ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: a1521934-0c83-4c3e-9203-a567454189d1, pool_id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 9f4461a9-bb1f-4558-aee7-25c760444ba5, pool_id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 95fba161-2de9-449d-bb4d-9cf1b74e86e8, pool_id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: b56ed229-e2d8-4457-a006-d193de1f9451, pool_id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 5cc7fc31-1600-4405-b054-a17e04c46cbd, pool_id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 09dd2907-0b0b-4f79-aff1-acbf5aed6bdd, pool_id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: e96e512e-4273-4b34-bd08-00fa48678a96, pool_id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: fa335023-72d3-4a98-b2a3-342d8945607a, pool_id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 4b431867-7f3e-474e-b8c9-556ca74df0d5, pool_id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2712024-11-19T19:36:51.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60726
2722024-11-19T19:36:51.403ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:883 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2732024-11-19T19:36:51.403ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: a1521934-0c83-4c3e-9203-a567454189d1, pool_id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 9f4461a9-bb1f-4558-aee7-25c760444ba5, pool_id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 95fba161-2de9-449d-bb4d-9cf1b74e86e8, pool_id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: b56ed229-e2d8-4457-a006-d193de1f9451, pool_id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 5cc7fc31-1600-4405-b054-a17e04c46cbd, pool_id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 09dd2907-0b0b-4f79-aff1-acbf5aed6bdd, pool_id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: e96e512e-4273-4b34-bd08-00fa48678a96, pool_id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: fa335023-72d3-4a98-b2a3-342d8945607a, pool_id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 4b431867-7f3e-474e-b8c9-556ca74df0d5, pool_id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2742024-11-19T19:36:51.403ZINFOSledAgent (StorageManager): No ledger in /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = omicron_physical_disks_ensure
2752024-11-19T19:36:51.403ZINFOSledAgent (StorageManager): No ledger in /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = omicron_physical_disks_ensure
2762024-11-19T19:36:51.403ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1175 request = omicron_physical_disks_ensure
2772024-11-19T19:36:51.403ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2782024-11-19T19:36:51.403ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2792024-11-19T19:36:51.403ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2802024-11-19T19:36:51.403ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2812024-11-19T19:36:51.525ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2822024-11-19T19:36:51.525ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool)
2832024-11-19T19:36:51.758ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.443478843s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2842024-11-19T19:36:51.971ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 633340610555715702 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2852024-11-19T19:36:51.971ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14499540168669099160 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2862024-11-19T19:36:51.971ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/probe_manager.rs:231 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2872024-11-19T19:36:52.174ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
2882024-11-19T19:36:52.224ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }
2892024-11-19T19:36:52.232ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2902024-11-19T19:36:52.232ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2912024-11-19T19:36:52.232ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2922024-11-19T19:36:52.232ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2932024-11-19T19:36:52.232ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2942024-11-19T19:36:52.232ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2952024-11-19T19:36:52.232ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2962024-11-19T19:36:52.269ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2972024-11-19T19:36:52.277ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/zone file = sled-storage/src/dataset.rs:303
2982024-11-19T19:36:52.454ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a60d50c5-1d31-4171-ba2e-661c260a4561 file = sled-storage/src/dataset.rs:389
2992024-11-19T19:36:52.462ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
3002024-11-19T19:36:52.462ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
3012024-11-19T19:36:52.462ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
3022024-11-19T19:36:52.462ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3032024-11-19T19:36:52.462ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
3042024-11-19T19:36:52.472ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
3052024-11-19T19:36:52.472ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool)
3062024-11-19T19:36:52.567ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }
3072024-11-19T19:36:52.575ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3082024-11-19T19:36:52.575ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3092024-11-19T19:36:52.575ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3102024-11-19T19:36:52.575ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3112024-11-19T19:36:52.575ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-11-19T19:36:52.576ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3132024-11-19T19:36:52.576ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3142024-11-19T19:36:52.609ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3152024-11-19T19:36:52.617ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/zone file = sled-storage/src/dataset.rs:303
3162024-11-19T19:36:52.791ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_be436df4-34a1-4101-90ff-be2f8ef7e824 file = sled-storage/src/dataset.rs:389
3172024-11-19T19:36:52.800ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3182024-11-19T19:36:52.800ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3192024-11-19T19:36:52.800ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3202024-11-19T19:36:52.800ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3212024-11-19T19:36:52.800ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3222024-11-19T19:36:52.809ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3232024-11-19T19:36:52.810ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = af234a87-284a-4af4-aac4-6b58ea279f05 (zpool)
3242024-11-19T19:36:52.904ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }
3252024-11-19T19:36:52.912ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3262024-11-19T19:36:52.913ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3272024-11-19T19:36:52.913ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3282024-11-19T19:36:52.913ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3292024-11-19T19:36:52.913ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-11-19T19:36:52.913ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3312024-11-19T19:36:52.913ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3322024-11-19T19:36:52.951ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3332024-11-19T19:36:52.959ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_af234a87-284a-4af4-aac4-6b58ea279f05/crypt/zone file = sled-storage/src/dataset.rs:303
3342024-11-19T19:36:52.976ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/probe_manager.rs:231 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
3352024-11-19T19:36:53.129ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_af234a87-284a-4af4-aac4-6b58ea279f05 file = sled-storage/src/dataset.rs:389
3362024-11-19T19:36:53.137ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3372024-11-19T19:36:53.137ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3382024-11-19T19:36:53.137ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3392024-11-19T19:36:53.137ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3402024-11-19T19:36:53.137ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3412024-11-19T19:36:53.147ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3422024-11-19T19:36:53.147ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 43c663f2-b051-403e-bcad-e419348a9017 (zpool)
3432024-11-19T19:36:53.240ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }
3442024-11-19T19:36:53.247ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3452024-11-19T19:36:53.247ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3462024-11-19T19:36:53.247ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3472024-11-19T19:36:53.247ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3482024-11-19T19:36:53.247ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3492024-11-19T19:36:53.248ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3502024-11-19T19:36:53.248ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3512024-11-19T19:36:53.283ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3522024-11-19T19:36:53.290ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_43c663f2-b051-403e-bcad-e419348a9017/crypt/zone file = sled-storage/src/dataset.rs:303
3532024-11-19T19:36:53.460ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_43c663f2-b051-403e-bcad-e419348a9017 file = sled-storage/src/dataset.rs:389
3542024-11-19T19:36:53.467ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3552024-11-19T19:36:53.467ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3562024-11-19T19:36:53.467ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3572024-11-19T19:36:53.467ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3582024-11-19T19:36:53.467ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3592024-11-19T19:36:53.477ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3602024-11-19T19:36:53.477ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool)
3612024-11-19T19:36:53.572ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }
3622024-11-19T19:36:53.580ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3632024-11-19T19:36:53.580ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3642024-11-19T19:36:53.580ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3652024-11-19T19:36:53.580ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3662024-11-19T19:36:53.580ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3672024-11-19T19:36:53.580ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3682024-11-19T19:36:53.580ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3692024-11-19T19:36:53.615ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3702024-11-19T19:36:53.623ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c/crypt/zone file = sled-storage/src/dataset.rs:303
3712024-11-19T19:36:53.801ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c file = sled-storage/src/dataset.rs:389
3722024-11-19T19:36:53.809ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3732024-11-19T19:36:53.809ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3742024-11-19T19:36:53.809ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3752024-11-19T19:36:53.809ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3762024-11-19T19:36:53.809ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3772024-11-19T19:36:53.819ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3782024-11-19T19:36:53.819ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool)
3792024-11-19T19:36:53.912ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }
3802024-11-19T19:36:53.920ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3812024-11-19T19:36:53.920ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3822024-11-19T19:36:53.920ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3832024-11-19T19:36:53.920ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3842024-11-19T19:36:53.920ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-11-19T19:36:53.920ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3862024-11-19T19:36:53.920ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3872024-11-19T19:36:53.956ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3882024-11-19T19:36:53.965ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b5075ce0-4de0-43fe-a8e8-40bff047022b/crypt/zone file = sled-storage/src/dataset.rs:303
3892024-11-19T19:36:53.981ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/probe_manager.rs:231 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
3902024-11-19T19:36:54.140ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b5075ce0-4de0-43fe-a8e8-40bff047022b file = sled-storage/src/dataset.rs:389
3912024-11-19T19:36:54.148ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3922024-11-19T19:36:54.148ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3932024-11-19T19:36:54.148ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3942024-11-19T19:36:54.148ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3952024-11-19T19:36:54.148ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3962024-11-19T19:36:54.157ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3972024-11-19T19:36:54.157ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fa881b81-fb55-465b-a7d1-159614622ca4 (zpool)
3982024-11-19T19:36:54.245ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }
3992024-11-19T19:36:54.252ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
4002024-11-19T19:36:54.252ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
4012024-11-19T19:36:54.252ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
4022024-11-19T19:36:54.252ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
4032024-11-19T19:36:54.252ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-11-19T19:36:54.252ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4052024-11-19T19:36:54.252ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4062024-11-19T19:36:54.285ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4072024-11-19T19:36:54.292ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fa881b81-fb55-465b-a7d1-159614622ca4/crypt/zone file = sled-storage/src/dataset.rs:303
4082024-11-19T19:36:54.473ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fa881b81-fb55-465b-a7d1-159614622ca4 file = sled-storage/src/dataset.rs:389
4092024-11-19T19:36:54.482ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4102024-11-19T19:36:54.482ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4112024-11-19T19:36:54.482ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4122024-11-19T19:36:54.482ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4132024-11-19T19:36:54.482ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4142024-11-19T19:36:54.491ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4152024-11-19T19:36:54.491ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool)
4162024-11-19T19:36:54.605ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }
4172024-11-19T19:36:54.612ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4182024-11-19T19:36:54.612ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4192024-11-19T19:36:54.612ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4202024-11-19T19:36:54.612ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4212024-11-19T19:36:54.612ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-11-19T19:36:54.612ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4232024-11-19T19:36:54.612ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4242024-11-19T19:36:54.648ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4252024-11-19T19:36:54.656ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5d346fc3-b1ff-469c-a353-925addba06e4/crypt/zone file = sled-storage/src/dataset.rs:303
4262024-11-19T19:36:54.833ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5d346fc3-b1ff-469c-a353-925addba06e4 file = sled-storage/src/dataset.rs:389
4272024-11-19T19:36:54.841ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4282024-11-19T19:36:54.841ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4292024-11-19T19:36:54.841ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4302024-11-19T19:36:54.841ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4312024-11-19T19:36:54.841ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4322024-11-19T19:36:54.850ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4332024-11-19T19:36:54.850ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool)
4342024-11-19T19:36:54.943ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }
4352024-11-19T19:36:54.951ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4362024-11-19T19:36:54.951ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4372024-11-19T19:36:54.951ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4382024-11-19T19:36:54.951ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4392024-11-19T19:36:54.951ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4402024-11-19T19:36:54.951ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4412024-11-19T19:36:54.951ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4422024-11-19T19:36:54.986ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/probe_manager.rs:231 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
4432024-11-19T19:36:54.988ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4442024-11-19T19:36:54.996ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3cdbf8c9-3584-411d-8acb-3e587708315a/crypt/zone file = sled-storage/src/dataset.rs:303
4452024-11-19T19:36:55.169ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3cdbf8c9-3584-411d-8acb-3e587708315a file = sled-storage/src/dataset.rs:389
4462024-11-19T19:36:55.177ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4472024-11-19T19:36:55.177ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4482024-11-19T19:36:55.177ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:200 request = omicron_physical_disks_ensure
4492024-11-19T19:36:55.177ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fbc1611e-058f-49c8-948e-b1a1af061463 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d3dd1034-4279-4c8b-a3e7-e06018ad7ea1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4502024-11-19T19:36:55.177ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4512024-11-19T19:36:55.177ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4522024-11-19T19:36:55.178ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-physical-disks.json" request = omicron_physical_disks_ensure
4532024-11-19T19:36:55.178ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:200 request = omicron_physical_disks_ensure
4542024-11-19T19:36:55.178ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-physical-disks.json" request = omicron_physical_disks_ensure
4552024-11-19T19:36:55.178ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:887 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
4562024-11-19T19:36:55.178ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4572024-11-19T19:36:55.178ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:913 generation = Generation(1) sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
4582024-11-19T19:36:55.178ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:918 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
4592024-11-19T19:36:55.178ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:923 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
4602024-11-19T19:36:55.178ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
4612024-11-19T19:36:55.178ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:929 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
4622024-11-19T19:36:55.178ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4632024-11-19T19:36:55.178ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:934 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
4642024-11-19T19:36:55.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3774952 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60726 req_id = 5e3e2942-e8e7-493e-bac2-1b9763100ef7 response_code = 200 uri = /omicron-physical-disks
4652024-11-19T19:36:55.209ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {00bd7942-50dc-4bb9-bb39-b59a7c5837f3 (dataset): DatasetConfig { id: 00bd7942-50dc-4bb9-bb39-b59a7c5837f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 01a2a813-c757-4c39-af81-4231240eff8e (dataset): DatasetConfig { id: 01a2a813-c757-4c39-af81-4231240eff8e (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02be6443-b799-42da-99d2-f0d9ef529fc0 (dataset): DatasetConfig { id: 02be6443-b799-42da-99d2-f0d9ef529fc0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 03c3e07b-34e8-419b-98b8-04a2f2735293 (dataset): DatasetConfig { id: 03c3e07b-34e8-419b-98b8-04a2f2735293 (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 041fbdee-0ecc-4127-85ba-6781e00907dc (dataset): DatasetConfig { id: 041fbdee-0ecc-4127-85ba-6781e00907dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08785b8d-5cdf-4a90-9187-a27595ecf98b (dataset): DatasetConfig { id: 08785b8d-5cdf-4a90-9187-a27595ecf98b (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e1a7332-c441-4c74-9999-2108c2b3fd11 (dataset): DatasetConfig { id: 0e1a7332-c441-4c74-9999-2108c2b3fd11 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 101a1a02-a1b0-4be3-bf18-89dba2d40567 (dataset): DatasetConfig { id: 101a1a02-a1b0-4be3-bf18-89dba2d40567 (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10a9c627-d71f-42db-843f-dd5811002a15 (dataset): DatasetConfig { id: 10a9c627-d71f-42db-843f-dd5811002a15 (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13699964-5af7-413e-8f00-c461c64075c2 (dataset): DatasetConfig { id: 13699964-5af7-413e-8f00-c461c64075c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 178ee470-fa48-4fee-bb9a-14fb795e1cf7 (dataset): DatasetConfig { id: 178ee470-fa48-4fee-bb9a-14fb795e1cf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ccc421e-117f-43be-bafb-ae5b6d3fd06d (dataset): DatasetConfig { id: 1ccc421e-117f-43be-bafb-ae5b6d3fd06d (dataset), name: DatasetName { pool_name: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ef8d01a-b585-49c8-a333-a8bc3d096b74 (dataset): DatasetConfig { id: 1ef8d01a-b585-49c8-a333-a8bc3d096b74 (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 21ea706f-ec21-487f-9382-a81570ca09c3 (dataset): DatasetConfig { id: 21ea706f-ec21-487f-9382-a81570ca09c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 238dbc35-870f-4ab2-9bff-9b49b0d8d3ea (dataset): DatasetConfig { id: 238dbc35-870f-4ab2-9bff-9b49b0d8d3ea (dataset), name: DatasetName { pool_name: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23ae8e3d-90bb-4597-b158-697ac63f194e (dataset): DatasetConfig { id: 23ae8e3d-90bb-4597-b158-697ac63f194e (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2730ae1a-63fd-47fe-9a9b-90bbbb8c2067 (dataset): DatasetConfig { id: 2730ae1a-63fd-47fe-9a9b-90bbbb8c2067 (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c628244-3362-4785-bf4f-a74fd2d30e12 (dataset): DatasetConfig { id: 2c628244-3362-4785-bf4f-a74fd2d30e12 (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33192931-08ab-4706-a996-2c2da4fedb64 (dataset): DatasetConfig { id: 33192931-08ab-4706-a996-2c2da4fedb64 (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 34e58a2d-f9e9-4dea-a773-bbdd4ee3b911 (dataset): DatasetConfig { id: 34e58a2d-f9e9-4dea-a773-bbdd4ee3b911 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3614f8bc-b14c-41ea-8abd-1f9c140926b3 (dataset): DatasetConfig { id: 3614f8bc-b14c-41ea-8abd-1f9c140926b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3945e0f1-418d-4933-860a-1d17e5e72b94 (dataset): DatasetConfig { id: 3945e0f1-418d-4933-860a-1d17e5e72b94 (dataset), name: DatasetName { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4535ef30-2cc9-42cf-8a5f-72493200d292 (dataset): DatasetConfig { id: 4535ef30-2cc9-42cf-8a5f-72493200d292 (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4563c9b4-7567-49eb-94a6-502060dc1987 (dataset): DatasetConfig { id: 4563c9b4-7567-49eb-94a6-502060dc1987 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d2ff6f1-2499-4af6-89bd-7fa5aa890f36 (dataset): DatasetConfig { id: 4d2ff6f1-2499-4af6-89bd-7fa5aa890f36 (dataset), name: DatasetName { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54219a02-de55-495b-b530-efd0492284f8 (dataset): DatasetConfig { id: 54219a02-de55-495b-b530-efd0492284f8 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bed2662-815a-475f-a6aa-e04935f2eb6e (dataset): DatasetConfig { id: 5bed2662-815a-475f-a6aa-e04935f2eb6e (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d448c99-d9bf-4527-8f34-109b1f4db5a5 (dataset): DatasetConfig { id: 5d448c99-d9bf-4527-8f34-109b1f4db5a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68d9b634-1d1b-4070-ad7f-636f967b2221 (dataset): DatasetConfig { id: 68d9b634-1d1b-4070-ad7f-636f967b2221 (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71f4189e-eae8-4812-a868-62f6913c27bf (dataset): DatasetConfig { id: 71f4189e-eae8-4812-a868-62f6913c27bf (dataset), name: DatasetName { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77a54023-cb26-4a10-ae7b-b4d5cc0b5bef (dataset): DatasetConfig { id: 77a54023-cb26-4a10-ae7b-b4d5cc0b5bef (dataset), name: DatasetName { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a1e9507-812c-42d5-b89a-c882b8039baa (dataset): DatasetConfig { id: 7a1e9507-812c-42d5-b89a-c882b8039baa (dataset), name: DatasetName { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d125262-aa69-4756-99bb-7b3265a2689b (dataset): DatasetConfig { id: 7d125262-aa69-4756-99bb-7b3265a2689b (dataset), name: DatasetName { pool_name: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 832c1a7c-69f4-4242-99d2-4a14366c7ddf (dataset): DatasetConfig { id: 832c1a7c-69f4-4242-99d2-4a14366c7ddf (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85801221-7c59-4bd4-ae15-5f7835663237 (dataset): DatasetConfig { id: 85801221-7c59-4bd4-ae15-5f7835663237 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 88ba0e65-17e6-47ff-ae24-346c34cc549e (dataset): DatasetConfig { id: 88ba0e65-17e6-47ff-ae24-346c34cc549e (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89a4e088-c515-42a7-91cc-6217b5c6222f (dataset): DatasetConfig { id: 89a4e088-c515-42a7-91cc-6217b5c6222f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8efa7663-9eea-494a-bcf5-5a219278e202 (dataset): DatasetConfig { id: 8efa7663-9eea-494a-bcf5-5a219278e202 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 930e3a82-e3e1-4a91-9c1b-164d25bf8719 (dataset): DatasetConfig { id: 930e3a82-e3e1-4a91-9c1b-164d25bf8719 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 98f57d9d-baef-4d02-b3cd-ee34011d65a1 (dataset): DatasetConfig { id: 98f57d9d-baef-4d02-b3cd-ee34011d65a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9cf2cd9b-e49f-4902-a2dd-337e234c84c2 (dataset): DatasetConfig { id: 9cf2cd9b-e49f-4902-a2dd-337e234c84c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2b8d49d-3979-4d5d-bc65-1903390ffda9 (dataset): DatasetConfig { id: a2b8d49d-3979-4d5d-bc65-1903390ffda9 (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a60a0707-c5b1-4c71-9644-cbe15a7f3c2e (dataset): DatasetConfig { id: a60a0707-c5b1-4c71-9644-cbe15a7f3c2e (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a7f73f9d-0974-4e2e-b68d-61885bead183 (dataset): DatasetConfig { id: a7f73f9d-0974-4e2e-b68d-61885bead183 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aca2d544-843c-4ca3-b367-a5970decfbcf (dataset): DatasetConfig { id: aca2d544-843c-4ca3-b367-a5970decfbcf (dataset), name: DatasetName { pool_name: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aecf97c4-0db6-450f-be6d-f84efc8a2f56 (dataset): DatasetConfig { id: aecf97c4-0db6-450f-be6d-f84efc8a2f56 (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aeee131c-961a-4993-a314-d731001a819f (dataset): DatasetConfig { id: aeee131c-961a-4993-a314-d731001a819f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b94a682b-39da-4dc7-b632-a4ae28527ed9 (dataset): DatasetConfig { id: b94a682b-39da-4dc7-b632-a4ae28527ed9 (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbd932f6-f71f-4a59-bff8-05c272d1480a (dataset): DatasetConfig { id: bbd932f6-f71f-4a59-bff8-05c272d1480a (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c98e6754-1e52-4bd5-9356-cf04a3a787d1 (dataset): DatasetConfig { id: c98e6754-1e52-4bd5-9356-cf04a3a787d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cad1aaf6-ae6c-4032-9507-9e62598b4310 (dataset): DatasetConfig { id: cad1aaf6-ae6c-4032-9507-9e62598b4310 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cbdfc48f-8c53-421d-b749-fce71cfbca6f (dataset): DatasetConfig { id: cbdfc48f-8c53-421d-b749-fce71cfbca6f (dataset), name: DatasetName { pool_name: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cc231a98-8ae5-4627-b97a-9a5817b7bbb2 (dataset): DatasetConfig { id: cc231a98-8ae5-4627-b97a-9a5817b7bbb2 (dataset), name: DatasetName { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cdadc655-ac24-438c-adf0-c8f45746ab58 (dataset): DatasetConfig { id: cdadc655-ac24-438c-adf0-c8f45746ab58 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1bae937-c3b7-4899-bf83-4f2384059d32 (dataset): DatasetConfig { id: d1bae937-c3b7-4899-bf83-4f2384059d32 (dataset), name: DatasetName { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e3774459-cd71-4201-945b-422fa6090793" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d29ffa57-1a15-41aa-81ef-09264363f6b7 (dataset): DatasetConfig { id: d29ffa57-1a15-41aa-81ef-09264363f6b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8854fd7-9ebf-4486-bb0e-a4bc082e9395 (dataset): DatasetConfig { id: d8854fd7-9ebf-4486-bb0e-a4bc082e9395 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8b5cab4-1199-4724-a49e-18fbca4afb52 (dataset): DatasetConfig { id: d8b5cab4-1199-4724-a49e-18fbca4afb52 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dabfe0ac-aa66-4d42-b03f-ee4d5db98f3e (dataset): DatasetConfig { id: dabfe0ac-aa66-4d42-b03f-ee4d5db98f3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dcde5b18-5dc6-42de-a2e7-0448ccf91f58 (dataset): DatasetConfig { id: dcde5b18-5dc6-42de-a2e7-0448ccf91f58 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, df5fba1d-3e54-461a-b229-f116ec021d7f (dataset): DatasetConfig { id: df5fba1d-3e54-461a-b229-f116ec021d7f (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e61a492c-b80d-4134-aea9-65146d4de076 (dataset): DatasetConfig { id: e61a492c-b80d-4134-aea9-65146d4de076 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec900144-aa4c-4f5a-b108-b8f971dbd710 (dataset): DatasetConfig { id: ec900144-aa4c-4f5a-b108-b8f971dbd710 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2e651bc-3a3d-47a7-937b-8d24e9cd9740 (dataset): DatasetConfig { id: f2e651bc-3a3d-47a7-937b-8d24e9cd9740 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5428605-d202-4d5e-8419-7de59044c42d (dataset): DatasetConfig { id: f5428605-d202-4d5e-8419-7de59044c42d (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fc178ce6-ae8b-46ff-80a6-98dbcb744b26 (dataset): DatasetConfig { id: fc178ce6-ae8b-46ff-80a6-98dbcb744b26 (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4662024-11-19T19:36:55.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46080
4672024-11-19T19:36:55.210ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:849 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
4682024-11-19T19:36:55.210ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {00bd7942-50dc-4bb9-bb39-b59a7c5837f3 (dataset): DatasetConfig { id: 00bd7942-50dc-4bb9-bb39-b59a7c5837f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 01a2a813-c757-4c39-af81-4231240eff8e (dataset): DatasetConfig { id: 01a2a813-c757-4c39-af81-4231240eff8e (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02be6443-b799-42da-99d2-f0d9ef529fc0 (dataset): DatasetConfig { id: 02be6443-b799-42da-99d2-f0d9ef529fc0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 03c3e07b-34e8-419b-98b8-04a2f2735293 (dataset): DatasetConfig { id: 03c3e07b-34e8-419b-98b8-04a2f2735293 (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 041fbdee-0ecc-4127-85ba-6781e00907dc (dataset): DatasetConfig { id: 041fbdee-0ecc-4127-85ba-6781e00907dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08785b8d-5cdf-4a90-9187-a27595ecf98b (dataset): DatasetConfig { id: 08785b8d-5cdf-4a90-9187-a27595ecf98b (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e1a7332-c441-4c74-9999-2108c2b3fd11 (dataset): DatasetConfig { id: 0e1a7332-c441-4c74-9999-2108c2b3fd11 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 101a1a02-a1b0-4be3-bf18-89dba2d40567 (dataset): DatasetConfig { id: 101a1a02-a1b0-4be3-bf18-89dba2d40567 (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10a9c627-d71f-42db-843f-dd5811002a15 (dataset): DatasetConfig { id: 10a9c627-d71f-42db-843f-dd5811002a15 (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13699964-5af7-413e-8f00-c461c64075c2 (dataset): DatasetConfig { id: 13699964-5af7-413e-8f00-c461c64075c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 178ee470-fa48-4fee-bb9a-14fb795e1cf7 (dataset): DatasetConfig { id: 178ee470-fa48-4fee-bb9a-14fb795e1cf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ccc421e-117f-43be-bafb-ae5b6d3fd06d (dataset): DatasetConfig { id: 1ccc421e-117f-43be-bafb-ae5b6d3fd06d (dataset), name: DatasetName { pool_name: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ef8d01a-b585-49c8-a333-a8bc3d096b74 (dataset): DatasetConfig { id: 1ef8d01a-b585-49c8-a333-a8bc3d096b74 (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 21ea706f-ec21-487f-9382-a81570ca09c3 (dataset): DatasetConfig { id: 21ea706f-ec21-487f-9382-a81570ca09c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 238dbc35-870f-4ab2-9bff-9b49b0d8d3ea (dataset): DatasetConfig { id: 238dbc35-870f-4ab2-9bff-9b49b0d8d3ea (dataset), name: DatasetName { pool_name: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23ae8e3d-90bb-4597-b158-697ac63f194e (dataset): DatasetConfig { id: 23ae8e3d-90bb-4597-b158-697ac63f194e (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2730ae1a-63fd-47fe-9a9b-90bbbb8c2067 (dataset): DatasetConfig { id: 2730ae1a-63fd-47fe-9a9b-90bbbb8c2067 (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c628244-3362-4785-bf4f-a74fd2d30e12 (dataset): DatasetConfig { id: 2c628244-3362-4785-bf4f-a74fd2d30e12 (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33192931-08ab-4706-a996-2c2da4fedb64 (dataset): DatasetConfig { id: 33192931-08ab-4706-a996-2c2da4fedb64 (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 34e58a2d-f9e9-4dea-a773-bbdd4ee3b911 (dataset): DatasetConfig { id: 34e58a2d-f9e9-4dea-a773-bbdd4ee3b911 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3614f8bc-b14c-41ea-8abd-1f9c140926b3 (dataset): DatasetConfig { id: 3614f8bc-b14c-41ea-8abd-1f9c140926b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3945e0f1-418d-4933-860a-1d17e5e72b94 (dataset): DatasetConfig { id: 3945e0f1-418d-4933-860a-1d17e5e72b94 (dataset), name: DatasetName { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4535ef30-2cc9-42cf-8a5f-72493200d292 (dataset): DatasetConfig { id: 4535ef30-2cc9-42cf-8a5f-72493200d292 (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4563c9b4-7567-49eb-94a6-502060dc1987 (dataset): DatasetConfig { id: 4563c9b4-7567-49eb-94a6-502060dc1987 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d2ff6f1-2499-4af6-89bd-7fa5aa890f36 (dataset): DatasetConfig { id: 4d2ff6f1-2499-4af6-89bd-7fa5aa890f36 (dataset), name: DatasetName { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54219a02-de55-495b-b530-efd0492284f8 (dataset): DatasetConfig { id: 54219a02-de55-495b-b530-efd0492284f8 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bed2662-815a-475f-a6aa-e04935f2eb6e (dataset): DatasetConfig { id: 5bed2662-815a-475f-a6aa-e04935f2eb6e (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d448c99-d9bf-4527-8f34-109b1f4db5a5 (dataset): DatasetConfig { id: 5d448c99-d9bf-4527-8f34-109b1f4db5a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68d9b634-1d1b-4070-ad7f-636f967b2221 (dataset): DatasetConfig { id: 68d9b634-1d1b-4070-ad7f-636f967b2221 (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71f4189e-eae8-4812-a868-62f6913c27bf (dataset): DatasetConfig { id: 71f4189e-eae8-4812-a868-62f6913c27bf (dataset), name: DatasetName { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77a54023-cb26-4a10-ae7b-b4d5cc0b5bef (dataset): DatasetConfig { id: 77a54023-cb26-4a10-ae7b-b4d5cc0b5bef (dataset), name: DatasetName { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a1e9507-812c-42d5-b89a-c882b8039baa (dataset): DatasetConfig { id: 7a1e9507-812c-42d5-b89a-c882b8039baa (dataset), name: DatasetName { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d125262-aa69-4756-99bb-7b3265a2689b (dataset): DatasetConfig { id: 7d125262-aa69-4756-99bb-7b3265a2689b (dataset), name: DatasetName { pool_name: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 832c1a7c-69f4-4242-99d2-4a14366c7ddf (dataset): DatasetConfig { id: 832c1a7c-69f4-4242-99d2-4a14366c7ddf (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85801221-7c59-4bd4-ae15-5f7835663237 (dataset): DatasetConfig { id: 85801221-7c59-4bd4-ae15-5f7835663237 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 88ba0e65-17e6-47ff-ae24-346c34cc549e (dataset): DatasetConfig { id: 88ba0e65-17e6-47ff-ae24-346c34cc549e (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89a4e088-c515-42a7-91cc-6217b5c6222f (dataset): DatasetConfig { id: 89a4e088-c515-42a7-91cc-6217b5c6222f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8efa7663-9eea-494a-bcf5-5a219278e202 (dataset): DatasetConfig { id: 8efa7663-9eea-494a-bcf5-5a219278e202 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 930e3a82-e3e1-4a91-9c1b-164d25bf8719 (dataset): DatasetConfig { id: 930e3a82-e3e1-4a91-9c1b-164d25bf8719 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 98f57d9d-baef-4d02-b3cd-ee34011d65a1 (dataset): DatasetConfig { id: 98f57d9d-baef-4d02-b3cd-ee34011d65a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9cf2cd9b-e49f-4902-a2dd-337e234c84c2 (dataset): DatasetConfig { id: 9cf2cd9b-e49f-4902-a2dd-337e234c84c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2b8d49d-3979-4d5d-bc65-1903390ffda9 (dataset): DatasetConfig { id: a2b8d49d-3979-4d5d-bc65-1903390ffda9 (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a60a0707-c5b1-4c71-9644-cbe15a7f3c2e (dataset): DatasetConfig { id: a60a0707-c5b1-4c71-9644-cbe15a7f3c2e (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a7f73f9d-0974-4e2e-b68d-61885bead183 (dataset): DatasetConfig { id: a7f73f9d-0974-4e2e-b68d-61885bead183 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aca2d544-843c-4ca3-b367-a5970decfbcf (dataset): DatasetConfig { id: aca2d544-843c-4ca3-b367-a5970decfbcf (dataset), name: DatasetName { pool_name: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aecf97c4-0db6-450f-be6d-f84efc8a2f56 (dataset): DatasetConfig { id: aecf97c4-0db6-450f-be6d-f84efc8a2f56 (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aeee131c-961a-4993-a314-d731001a819f (dataset): DatasetConfig { id: aeee131c-961a-4993-a314-d731001a819f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b94a682b-39da-4dc7-b632-a4ae28527ed9 (dataset): DatasetConfig { id: b94a682b-39da-4dc7-b632-a4ae28527ed9 (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbd932f6-f71f-4a59-bff8-05c272d1480a (dataset): DatasetConfig { id: bbd932f6-f71f-4a59-bff8-05c272d1480a (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c98e6754-1e52-4bd5-9356-cf04a3a787d1 (dataset): DatasetConfig { id: c98e6754-1e52-4bd5-9356-cf04a3a787d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cad1aaf6-ae6c-4032-9507-9e62598b4310 (dataset): DatasetConfig { id: cad1aaf6-ae6c-4032-9507-9e62598b4310 (dataset), name: DatasetName { pool_name: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cbdfc48f-8c53-421d-b749-fce71cfbca6f (dataset): DatasetConfig { id: cbdfc48f-8c53-421d-b749-fce71cfbca6f (dataset), name: DatasetName { pool_name: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cc231a98-8ae5-4627-b97a-9a5817b7bbb2 (dataset): DatasetConfig { id: cc231a98-8ae5-4627-b97a-9a5817b7bbb2 (dataset), name: DatasetName { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cdadc655-ac24-438c-adf0-c8f45746ab58 (dataset): DatasetConfig { id: cdadc655-ac24-438c-adf0-c8f45746ab58 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1bae937-c3b7-4899-bf83-4f2384059d32 (dataset): DatasetConfig { id: d1bae937-c3b7-4899-bf83-4f2384059d32 (dataset), name: DatasetName { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e3774459-cd71-4201-945b-422fa6090793" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d29ffa57-1a15-41aa-81ef-09264363f6b7 (dataset): DatasetConfig { id: d29ffa57-1a15-41aa-81ef-09264363f6b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8854fd7-9ebf-4486-bb0e-a4bc082e9395 (dataset): DatasetConfig { id: d8854fd7-9ebf-4486-bb0e-a4bc082e9395 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8b5cab4-1199-4724-a49e-18fbca4afb52 (dataset): DatasetConfig { id: d8b5cab4-1199-4724-a49e-18fbca4afb52 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dabfe0ac-aa66-4d42-b03f-ee4d5db98f3e (dataset): DatasetConfig { id: dabfe0ac-aa66-4d42-b03f-ee4d5db98f3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dcde5b18-5dc6-42de-a2e7-0448ccf91f58 (dataset): DatasetConfig { id: dcde5b18-5dc6-42de-a2e7-0448ccf91f58 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, df5fba1d-3e54-461a-b229-f116ec021d7f (dataset): DatasetConfig { id: df5fba1d-3e54-461a-b229-f116ec021d7f (dataset), name: DatasetName { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e61a492c-b80d-4134-aea9-65146d4de076 (dataset): DatasetConfig { id: e61a492c-b80d-4134-aea9-65146d4de076 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec900144-aa4c-4f5a-b108-b8f971dbd710 (dataset): DatasetConfig { id: ec900144-aa4c-4f5a-b108-b8f971dbd710 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2e651bc-3a3d-47a7-937b-8d24e9cd9740 (dataset): DatasetConfig { id: f2e651bc-3a3d-47a7-937b-8d24e9cd9740 (dataset), name: DatasetName { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5428605-d202-4d5e-8419-7de59044c42d (dataset): DatasetConfig { id: f5428605-d202-4d5e-8419-7de59044c42d (dataset), name: DatasetName { pool_name: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fc178ce6-ae8b-46ff-80a6-98dbcb744b26 (dataset): DatasetConfig { id: fc178ce6-ae8b-46ff-80a6-98dbcb744b26 (dataset), name: DatasetName { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4692024-11-19T19:36:55.210ZINFOSledAgent (StorageManager): No ledger in /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-datasets.json file = common/src/ledger.rs:189 request = datasets_ensure
4702024-11-19T19:36:55.210ZINFOSledAgent (StorageManager): No ledger in /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-datasets.json file = common/src/ledger.rs:189 request = datasets_ensure
4712024-11-19T19:36:55.210ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:906 request = datasets_ensure
4722024-11-19T19:36:55.210ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4732024-11-19T19:36:55.210ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d346fc3-b1ff-469c-a353-925addba06e4/crypt/zone/oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec"), full_name: "oxp_5d346fc3-b1ff-469c-a353-925addba06e4/crypt/zone/oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec" } file = sled-storage/src/manager.rs:1338
4742024-11-19T19:36:55.311ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4752024-11-19T19:36:55.311ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/zone/oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca"), full_name: "oxp_be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/zone/oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca" } file = sled-storage/src/manager.rs:1338
4762024-11-19T19:36:55.409ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4772024-11-19T19:36:55.409ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5075ce0-4de0-43fe-a8e8-40bff047022b/crypt/zone/oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed"), full_name: "oxp_b5075ce0-4de0-43fe-a8e8-40bff047022b/crypt/zone/oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed" } file = sled-storage/src/manager.rs:1338
4782024-11-19T19:36:55.509ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4792024-11-19T19:36:55.509ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/zone/oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded"), full_name: "oxp_a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/zone/oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded" } file = sled-storage/src/manager.rs:1338
4802024-11-19T19:36:55.611ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4812024-11-19T19:36:55.611ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3cdbf8c9-3584-411d-8acb-3e587708315a/crucible" } file = sled-storage/src/manager.rs:1338
4822024-11-19T19:36:55.700ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4832024-11-19T19:36:55.700ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/zone/oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3"), full_name: "oxp_be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/zone/oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3" } file = sled-storage/src/manager.rs:1338
4842024-11-19T19:36:55.802ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4852024-11-19T19:36:55.803ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5d346fc3-b1ff-469c-a353-925addba06e4/crucible" } file = sled-storage/src/manager.rs:1338
4862024-11-19T19:36:55.890ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4872024-11-19T19:36:55.890ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
4882024-11-19T19:36:55.979ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4892024-11-19T19:36:55.979ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a60d50c5-1d31-4171-ba2e-661c260a4561/crucible" } file = sled-storage/src/manager.rs:1338
4902024-11-19T19:36:55.990ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/probe_manager.rs:231 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
4912024-11-19T19:36:56.070ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4922024-11-19T19:36:56.070ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa881b81-fb55-465b-a7d1-159614622ca4/crypt/zone"), full_name: "oxp_fa881b81-fb55-465b-a7d1-159614622ca4/crypt/zone" } file = sled-storage/src/manager.rs:1338
4932024-11-19T19:36:56.139ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4942024-11-19T19:36:56.139ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c/crucible" } file = sled-storage/src/manager.rs:1338
4952024-11-19T19:36:56.228ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4962024-11-19T19:36:56.228ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
4972024-11-19T19:36:56.315ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4982024-11-19T19:36:56.315ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/clickhouse" } file = sled-storage/src/manager.rs:1338
4992024-11-19T19:36:56.405ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5002024-11-19T19:36:56.405ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/zone/oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d"), full_name: "oxp_a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/zone/oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d" } file = sled-storage/src/manager.rs:1338
5012024-11-19T19:36:56.505ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5022024-11-19T19:36:56.505ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f1d7fa4a-6150-4e79-a410-b71fd3b63c5c/crypt/zone/oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137"), full_name: "oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c/crypt/zone/oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137" } file = sled-storage/src/manager.rs:1338
5032024-11-19T19:36:56.603ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5042024-11-19T19:36:56.603ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/zone/oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58"), full_name: "oxp_a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/zone/oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58" } file = sled-storage/src/manager.rs:1338
5052024-11-19T19:36:56.702ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5062024-11-19T19:36:56.702ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5072024-11-19T19:36:56.793ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5082024-11-19T19:36:56.793ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/external_dns" } file = sled-storage/src/manager.rs:1338
5092024-11-19T19:36:56.883ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5102024-11-19T19:36:56.883ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/debug"), full_name: "oxp_be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/debug" } file = sled-storage/src/manager.rs:1338
5112024-11-19T19:36:56.952ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5122024-11-19T19:36:56.952ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/43c663f2-b051-403e-bcad-e419348a9017/crypt/zone/oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85"), full_name: "oxp_43c663f2-b051-403e-bcad-e419348a9017/crypt/zone/oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85" } file = sled-storage/src/manager.rs:1338
5132024-11-19T19:36:56.992ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/probe_manager.rs:231 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
5142024-11-19T19:36:57.052ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5152024-11-19T19:36:57.052ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_be436df4-34a1-4101-90ff-be2f8ef7e824/crucible" } file = sled-storage/src/manager.rs:1338
5162024-11-19T19:36:57.141ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5172024-11-19T19:36:57.141ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_af234a87-284a-4af4-aac4-6b58ea279f05/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5182024-11-19T19:36:57.203ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 13.182225379s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
5192024-11-19T19:36:57.232ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5202024-11-19T19:36:57.232ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/zone/oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd"), full_name: "oxp_a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/zone/oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd" } file = sled-storage/src/manager.rs:1338
5212024-11-19T19:36:57.331ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5222024-11-19T19:36:57.332ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3cdbf8c9-3584-411d-8acb-3e587708315a/crypt/zone"), full_name: "oxp_3cdbf8c9-3584-411d-8acb-3e587708315a/crypt/zone" } file = sled-storage/src/manager.rs:1338
5232024-11-19T19:36:57.400ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5242024-11-19T19:36:57.400ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/af234a87-284a-4af4-aac4-6b58ea279f05/crypt/zone"), full_name: "oxp_af234a87-284a-4af4-aac4-6b58ea279f05/crypt/zone" } file = sled-storage/src/manager.rs:1338
5252024-11-19T19:36:57.469ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5262024-11-19T19:36:57.469ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f1d7fa4a-6150-4e79-a410-b71fd3b63c5c/crypt/zone/oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383"), full_name: "oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c/crypt/zone/oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383" } file = sled-storage/src/manager.rs:1338
5272024-11-19T19:36:57.568ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5282024-11-19T19:36:57.568ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/external_dns" } file = sled-storage/src/manager.rs:1338
5292024-11-19T19:36:57.659ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5302024-11-19T19:36:57.659ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d346fc3-b1ff-469c-a353-925addba06e4/crypt/zone/oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94"), full_name: "oxp_5d346fc3-b1ff-469c-a353-925addba06e4/crypt/zone/oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94" } file = sled-storage/src/manager.rs:1338
5312024-11-19T19:36:57.759ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5322024-11-19T19:36:57.759ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/zone/oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d"), full_name: "oxp_be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/zone/oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d" } file = sled-storage/src/manager.rs:1338
5332024-11-19T19:36:57.862ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5342024-11-19T19:36:57.862ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/af234a87-284a-4af4-aac4-6b58ea279f05/crypt/zone/oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6"), full_name: "oxp_af234a87-284a-4af4-aac4-6b58ea279f05/crypt/zone/oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6" } file = sled-storage/src/manager.rs:1338
5352024-11-19T19:36:57.961ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5362024-11-19T19:36:57.961ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/43c663f2-b051-403e-bcad-e419348a9017/crypt/zone"), full_name: "oxp_43c663f2-b051-403e-bcad-e419348a9017/crypt/zone" } file = sled-storage/src/manager.rs:1338
5372024-11-19T19:36:57.994ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/probe_manager.rs:231 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
5382024-11-19T19:36:58.030ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5392024-11-19T19:36:58.030ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/af234a87-284a-4af4-aac4-6b58ea279f05/crypt/zone/oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a"), full_name: "oxp_af234a87-284a-4af4-aac4-6b58ea279f05/crypt/zone/oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a" } file = sled-storage/src/manager.rs:1338
5402024-11-19T19:36:58.132ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5412024-11-19T19:36:58.132ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b5075ce0-4de0-43fe-a8e8-40bff047022b/crucible" } file = sled-storage/src/manager.rs:1338
5422024-11-19T19:36:58.219ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5432024-11-19T19:36:58.219ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5442024-11-19T19:36:58.308ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5452024-11-19T19:36:58.309ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f1d7fa4a-6150-4e79-a410-b71fd3b63c5c/crypt/debug"), full_name: "oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c/crypt/debug" } file = sled-storage/src/manager.rs:1338
5462024-11-19T19:36:58.375ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5472024-11-19T19:36:58.375ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/zone"), full_name: "oxp_a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/zone" } file = sled-storage/src/manager.rs:1338
5482024-11-19T19:36:58.443ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5492024-11-19T19:36:58.443ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3cdbf8c9-3584-411d-8acb-3e587708315a/crypt/debug"), full_name: "oxp_3cdbf8c9-3584-411d-8acb-3e587708315a/crypt/debug" } file = sled-storage/src/manager.rs:1338
5502024-11-19T19:36:58.511ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5512024-11-19T19:36:58.511ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_43c663f2-b051-403e-bcad-e419348a9017/crucible" } file = sled-storage/src/manager.rs:1338
5522024-11-19T19:36:58.600ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5532024-11-19T19:36:58.600ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/43c663f2-b051-403e-bcad-e419348a9017/crypt/debug"), full_name: "oxp_43c663f2-b051-403e-bcad-e419348a9017/crypt/debug" } file = sled-storage/src/manager.rs:1338
5542024-11-19T19:36:58.668ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5552024-11-19T19:36:58.668ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_af234a87-284a-4af4-aac4-6b58ea279f05/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5562024-11-19T19:36:58.764ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5572024-11-19T19:36:58.764ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5075ce0-4de0-43fe-a8e8-40bff047022b/crypt/zone"), full_name: "oxp_b5075ce0-4de0-43fe-a8e8-40bff047022b/crypt/zone" } file = sled-storage/src/manager.rs:1338
5582024-11-19T19:36:58.832ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5592024-11-19T19:36:58.832ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/zone/oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625"), full_name: "oxp_be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/zone/oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625" } file = sled-storage/src/manager.rs:1338
5602024-11-19T19:36:58.933ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5612024-11-19T19:36:58.933ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/debug"), full_name: "oxp_a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/debug" } file = sled-storage/src/manager.rs:1338
5622024-11-19T19:36:58.997ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/probe_manager.rs:231 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
5632024-11-19T19:36:59.003ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5642024-11-19T19:36:59.003ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d346fc3-b1ff-469c-a353-925addba06e4/crypt/zone"), full_name: "oxp_5d346fc3-b1ff-469c-a353-925addba06e4/crypt/zone" } file = sled-storage/src/manager.rs:1338
5652024-11-19T19:36:59.073ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5662024-11-19T19:36:59.073ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fa881b81-fb55-465b-a7d1-159614622ca4/crucible" } file = sled-storage/src/manager.rs:1338
5672024-11-19T19:36:59.163ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5682024-11-19T19:36:59.163ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/zone/oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c"), full_name: "oxp_be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/zone/oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c" } file = sled-storage/src/manager.rs:1338
5692024-11-19T19:36:59.263ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5702024-11-19T19:36:59.263ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d346fc3-b1ff-469c-a353-925addba06e4/crypt/zone/oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4"), full_name: "oxp_5d346fc3-b1ff-469c-a353-925addba06e4/crypt/zone/oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4" } file = sled-storage/src/manager.rs:1338
5712024-11-19T19:36:59.363ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5722024-11-19T19:36:59.363ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/zone/oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922"), full_name: "oxp_a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/zone/oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922" } file = sled-storage/src/manager.rs:1338
5732024-11-19T19:36:59.472ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5742024-11-19T19:36:59.472ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/zone/oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe"), full_name: "oxp_a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/zone/oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe" } file = sled-storage/src/manager.rs:1338
5752024-11-19T19:36:59.576ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5762024-11-19T19:36:59.576ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/af234a87-284a-4af4-aac4-6b58ea279f05/crypt/debug"), full_name: "oxp_af234a87-284a-4af4-aac4-6b58ea279f05/crypt/debug" } file = sled-storage/src/manager.rs:1338
5772024-11-19T19:36:59.646ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5782024-11-19T19:36:59.646ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f1d7fa4a-6150-4e79-a410-b71fd3b63c5c/crypt/zone"), full_name: "oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c/crypt/zone" } file = sled-storage/src/manager.rs:1338
5792024-11-19T19:36:59.718ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5802024-11-19T19:36:59.718ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5075ce0-4de0-43fe-a8e8-40bff047022b/crypt/debug"), full_name: "oxp_b5075ce0-4de0-43fe-a8e8-40bff047022b/crypt/debug" } file = sled-storage/src/manager.rs:1338
5812024-11-19T19:36:59.788ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5822024-11-19T19:36:59.788ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_af234a87-284a-4af4-aac4-6b58ea279f05/crucible" } file = sled-storage/src/manager.rs:1338
5832024-11-19T19:36:59.876ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5842024-11-19T19:36:59.876ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5075ce0-4de0-43fe-a8e8-40bff047022b/crypt/zone/oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516"), full_name: "oxp_b5075ce0-4de0-43fe-a8e8-40bff047022b/crypt/zone/oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516" } file = sled-storage/src/manager.rs:1338
5852024-11-19T19:36:59.977ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5862024-11-19T19:36:59.977ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/af234a87-284a-4af4-aac4-6b58ea279f05/crypt/zone/oxz_crucible_e3774459-cd71-4201-945b-422fa6090793"), full_name: "oxp_af234a87-284a-4af4-aac4-6b58ea279f05/crypt/zone/oxz_crucible_e3774459-cd71-4201-945b-422fa6090793" } file = sled-storage/src/manager.rs:1338
5872024-11-19T19:36:59.999ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/probe_manager.rs:231 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
5882024-11-19T19:37:00.076ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5892024-11-19T19:37:00.076ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3cdbf8c9-3584-411d-8acb-3e587708315a/crypt/zone/oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2"), full_name: "oxp_3cdbf8c9-3584-411d-8acb-3e587708315a/crypt/zone/oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2" } file = sled-storage/src/manager.rs:1338
5902024-11-19T19:37:00.183ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5912024-11-19T19:37:00.183ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/43c663f2-b051-403e-bcad-e419348a9017/crypt/zone/oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8"), full_name: "oxp_43c663f2-b051-403e-bcad-e419348a9017/crypt/zone/oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8" } file = sled-storage/src/manager.rs:1338
5922024-11-19T19:37:00.285ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5932024-11-19T19:37:00.285ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/43c663f2-b051-403e-bcad-e419348a9017/crypt/zone/oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b"), full_name: "oxp_43c663f2-b051-403e-bcad-e419348a9017/crypt/zone/oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b" } file = sled-storage/src/manager.rs:1338
5942024-11-19T19:37:00.383ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5952024-11-19T19:37:00.383ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_43c663f2-b051-403e-bcad-e419348a9017/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5962024-11-19T19:37:00.471ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5972024-11-19T19:37:00.471ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa881b81-fb55-465b-a7d1-159614622ca4/crypt/debug"), full_name: "oxp_fa881b81-fb55-465b-a7d1-159614622ca4/crypt/debug" } file = sled-storage/src/manager.rs:1338
5982024-11-19T19:37:00.536ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5992024-11-19T19:37:00.536ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/zone"), full_name: "oxp_be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/zone" } file = sled-storage/src/manager.rs:1338
6002024-11-19T19:37:00.575ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4350
6012024-11-19T19:37:00.575ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4360 gateway = fd00:1122:3344:101::1
6022024-11-19T19:37:00.582ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4374 gateway = fd00:1122:3344:101::1
6032024-11-19T19:37:00.582ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4439
6042024-11-19T19:37:00.613ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6052024-11-19T19:37:00.614ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa881b81-fb55-465b-a7d1-159614622ca4/crypt/zone/oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9"), full_name: "oxp_fa881b81-fb55-465b-a7d1-159614622ca4/crypt/zone/oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9" } file = sled-storage/src/manager.rs:1338
6062024-11-19T19:37:00.724ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6072024-11-19T19:37:00.724ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d346fc3-b1ff-469c-a353-925addba06e4/crypt/zone/oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e"), full_name: "oxp_5d346fc3-b1ff-469c-a353-925addba06e4/crypt/zone/oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e" } file = sled-storage/src/manager.rs:1338
6082024-11-19T19:37:00.736ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4505
6092024-11-19T19:37:00.736ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4532
6102024-11-19T19:37:00.777ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4545
6112024-11-19T19:37:00.777ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4391
6122024-11-19T19:37:00.829ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4433
6132024-11-19T19:37:00.829ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4512 rack_subnet = fd00:1122:3344::
6142024-11-19T19:37:00.836ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6152024-11-19T19:37:00.836ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/43c663f2-b051-403e-bcad-e419348a9017/crypt/zone/oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad"), full_name: "oxp_43c663f2-b051-403e-bcad-e419348a9017/crypt/zone/oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad" } file = sled-storage/src/manager.rs:1338
6162024-11-19T19:37:00.845ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7505803311932058612 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
6172024-11-19T19:37:00.845ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16187920963863030048 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
6182024-11-19T19:37:00.851ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4523
6192024-11-19T19:37:00.851ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4565
6202024-11-19T19:37:00.922ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4597
6212024-11-19T19:37:00.922ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4603
6222024-11-19T19:37:00.951ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6232024-11-19T19:37:00.951ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5d346fc3-b1ff-469c-a353-925addba06e4/crypt/debug"), full_name: "oxp_5d346fc3-b1ff-469c-a353-925addba06e4/crypt/debug" } file = sled-storage/src/manager.rs:1338
6242024-11-19T19:37:01.001ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/probe_manager.rs:231 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
6252024-11-19T19:37:01.017ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4644
6262024-11-19T19:37:01.017ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6272024-11-19T19:37:01.027ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6282024-11-19T19:37:01.027ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
6292024-11-19T19:37:01.056ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
6302024-11-19T19:37:01.057ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/nexus.rs:527 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
6312024-11-19T19:37:01.096ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
6322024-11-19T19:37:01.096ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
6332024-11-19T19:37:01.097ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 1
6342024-11-19T19:37:01.097ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
6352024-11-19T19:37:01.126ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:200 request = datasets_ensure
6362024-11-19T19:37:01.126ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-datasets.json" request = datasets_ensure
6372024-11-19T19:37:01.126ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:200 request = datasets_ensure
6382024-11-19T19:37:01.126ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-datasets.json" request = datasets_ensure
6392024-11-19T19:37:01.127ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:851 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
6402024-11-19T19:37:01.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5917391 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:46080 req_id = ecaa57ba-4aec-433e-8b68-156f3fb8415c response_code = 200 uri = /datasets
6412024-11-19T19:37:01.147ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
6422024-11-19T19:37:01.179ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 216d60cb-f227-4c7a-8ea8-b35a2477da58 (service), filesystem_pool: Some(ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: dc2135a1-6478-49d7-9c9f-6c155521750c (service), filesystem_pool: Some(ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 5ab01216-071b-4591-a0de-d5e1c8dacc5a (service), filesystem_pool: Some(ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6432024-11-19T19:37:01.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43617
6442024-11-19T19:37:01.180ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6452024-11-19T19:37:01.180ZINFOSledAgent (ServiceManager): No ledger in /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json file = common/src/ledger.rs:189
6462024-11-19T19:37:01.180ZINFOSledAgent (ServiceManager): No ledger in /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json file = common/src/ledger.rs:189
6472024-11-19T19:37:01.180ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
6482024-11-19T19:37:01.180ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
6492024-11-19T19:37:01.180ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
6502024-11-19T19:37:01.180ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
6512024-11-19T19:37:01.181ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6522024-11-19T19:37:01.199ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6532024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6542024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6552024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6562024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6572024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6582024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6592024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6602024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6612024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6622024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6632024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6642024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6652024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6662024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6672024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6682024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6692024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6702024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6712024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6722024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6732024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6742024-11-19T19:37:01.200ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6752024-11-19T19:37:01.233ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6762024-11-19T19:37:01.233ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6772024-11-19T19:37:01.233ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6782024-11-19T19:37:01.288ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c file = illumos-utils/src/zone.rs:325
6792024-11-19T19:37:01.292ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a file = illumos-utils/src/zone.rs:325
6802024-11-19T19:37:01.296ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58 file = illumos-utils/src/zone.rs:325
6812024-11-19T19:37:01.308ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c file = illumos-utils/src/zone.rs:363
6822024-11-19T19:37:01.313ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a file = illumos-utils/src/zone.rs:363
6832024-11-19T19:37:01.317ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58 file = illumos-utils/src/zone.rs:363
6842024-11-19T19:37:01.973ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 633340610555715702 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
6852024-11-19T19:37:01.974ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14499540168669099160 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
6862024-11-19T19:37:02.004ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/probe_manager.rs:231 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
6872024-11-19T19:37:02.922ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6882024-11-19T19:37:02.922ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6892024-11-19T19:37:03.399ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6902024-11-19T19:37:03.399ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58
6912024-11-19T19:37:03.404ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6922024-11-19T19:37:03.889ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6932024-11-19T19:37:03.889ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a
6942024-11-19T19:37:03.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58") failed: Property not found. retry in 53.652745ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58
6952024-11-19T19:37:03.904ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6962024-11-19T19:37:03.904ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c
6972024-11-19T19:37:03.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58") failed: Property not found. retry in 104.593925ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58
6982024-11-19T19:37:04.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a") failed: Property not found. retry in 59.592329ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a
6992024-11-19T19:37:04.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c") failed: Property not found. retry in 59.479376ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c
7002024-11-19T19:37:04.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58") failed: Property not found. retry in 255.576801ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58
7012024-11-19T19:37:04.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a") failed: Property not found. retry in 124.300818ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a
7022024-11-19T19:37:04.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c") failed: Property not found. retry in 92.238434ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c
7032024-11-19T19:37:04.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a") failed: Property not found. retry in 245.8969ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a
7042024-11-19T19:37:04.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c") failed: Property not found. retry in 181.760952ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c
7052024-11-19T19:37:04.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58") failed: Property not found. retry in 422.221251ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58
7062024-11-19T19:37:04.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c") failed: Property not found. retry in 385.925298ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c
7072024-11-19T19:37:04.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a") failed: Property not found. retry in 333.767118ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a
7082024-11-19T19:37:04.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58") failed: Property not found. retry in 765.956786ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58
7092024-11-19T19:37:04.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a") failed: Property not found. retry in 462.897937ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a
7102024-11-19T19:37:04.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c") failed: Property not found. retry in 1.024024204s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c
7112024-11-19T19:37:05.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a") failed: Property not found. retry in 757.714219ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a
7122024-11-19T19:37:05.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58") failed: Property not found. retry in 1.053360823s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58
7132024-11-19T19:37:05.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c") failed: Property not found. retry in 1.133522305s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c
7142024-11-19T19:37:06.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a") failed: Property not found. retry in 1.140008799s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a
7152024-11-19T19:37:06.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58") failed: Property not found. retry in 960.975277ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58
7162024-11-19T19:37:07.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c") failed: Property not found. retry in 948.228285ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c
7172024-11-19T19:37:07.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a") failed: Property not found. retry in 547.08448ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a
7182024-11-19T19:37:07.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58") failed: Property not found. retry in 1.436977624s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58
7192024-11-19T19:37:07.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a") failed: Property not found. retry in 1.047634708s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a
7202024-11-19T19:37:08.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c") failed: Property not found. retry in 649.817792ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c
7212024-11-19T19:37:08.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c") failed: Property not found. retry in 1.231183993s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c
7222024-11-19T19:37:08.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a") failed: Property not found. retry in 1.217699459s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a
7232024-11-19T19:37:10.140ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_dc2135a1-6478-49d7-9c9f-6c155521750c
7242024-11-19T19:37:10.140ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_5ab01216-071b-4591-a0de-d5e1c8dacc5a
7252024-11-19T19:37:10.140ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_216d60cb-f227-4c7a-8ea8-b35a2477da58
7262024-11-19T19:37:10.140ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7272024-11-19T19:37:10.141ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json"
7282024-11-19T19:37:10.141ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7292024-11-19T19:37:10.141ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json"
7302024-11-19T19:37:10.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8961250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43617 req_id = c4cfcf78-f6b1-4510-96b6-7f92634a5a10 response_code = 204 uri = /omicron-zones
7312024-11-19T19:37:10.143ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7322024-11-19T19:37:10.191ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7332024-11-19T19:37:10.239ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7342024-11-19T19:37:10.286ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7352024-11-19T19:37:10.286ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7362024-11-19T19:37:10.318ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7372024-11-19T19:37:10.319ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7382024-11-19T19:37:10.319ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7392024-11-19T19:37:10.348ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 216d60cb-f227-4c7a-8ea8-b35a2477da58 (service), filesystem_pool: Some(ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: dc2135a1-6478-49d7-9c9f-6c155521750c (service), filesystem_pool: Some(ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 5ab01216-071b-4591-a0de-d5e1c8dacc5a (service), filesystem_pool: Some(ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 2ab43afe-f1ba-4f64-b73a-00dab8ed52ed (service), filesystem_pool: Some(ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 89fdd5c9-2720-410c-bc95-a64cd3087b4a, kind: Service { id: 2ab43afe-f1ba-4f64-b73a-00dab8ed52ed }, name: Name("ntp-2ab43afe-f1ba-4f64-b73a-00dab8ed52ed"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 1])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7402024-11-19T19:37:10.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49405
7412024-11-19T19:37:10.349ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7422024-11-19T19:37:10.349ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json file = common/src/ledger.rs:178
7432024-11-19T19:37:10.349ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json file = common/src/ledger.rs:178
7442024-11-19T19:37:10.349ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
7452024-11-19T19:37:10.349ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
7462024-11-19T19:37:10.349ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
7472024-11-19T19:37:10.349ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
7482024-11-19T19:37:10.349ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7492024-11-19T19:37:10.361ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7502024-11-19T19:37:10.393ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7512024-11-19T19:37:10.394ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7522024-11-19T19:37:10.394ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7532024-11-19T19:37:10.521ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 250, 1]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7542024-11-19T19:37:10.521ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = boundary_ntp
7552024-11-19T19:37:10.521ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7562024-11-19T19:37:10.521ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7572024-11-19T19:37:10.521ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7582024-11-19T19:37:10.522ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7592024-11-19T19:37:10.546ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed file = illumos-utils/src/zone.rs:325
7602024-11-19T19:37:10.565ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed file = illumos-utils/src/zone.rs:363
7612024-11-19T19:37:10.848ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7505803311932058612 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
7622024-11-19T19:37:10.849ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16187920963863030048 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
7632024-11-19T19:37:11.180ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7642024-11-19T19:37:11.181ZINFOSledAgent (ServiceManager): Booting oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed
7652024-11-19T19:37:11.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed") failed: Property not found. retry in 55.17056ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed
7662024-11-19T19:37:11.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed") failed: Property not found. retry in 104.398325ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed
7672024-11-19T19:37:11.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed") failed: Property not found. retry in 262.64569ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed
7682024-11-19T19:37:11.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed") failed: Property not found. retry in 257.746341ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed
7692024-11-19T19:37:11.976ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 633340610555715702 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
7702024-11-19T19:37:11.976ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14499540168669099160 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
7712024-11-19T19:37:12.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed") failed: Property not found. retry in 1.196795153s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed
7722024-11-19T19:37:13.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed") failed: Property not found. retry in 809.962219ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed
7732024-11-19T19:37:14.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed") failed: Property not found. retry in 763.317291ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed
7742024-11-19T19:37:14.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed") failed: Property not found. retry in 1.09000467s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed
7752024-11-19T19:37:15.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed") failed: Property not found. retry in 1.468837014s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed
7762024-11-19T19:37:17.431ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed
7772024-11-19T19:37:17.431ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7782024-11-19T19:37:17.431ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json"
7792024-11-19T19:37:17.431ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7802024-11-19T19:37:17.432ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json"
7812024-11-19T19:37:17.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7083323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49405 req_id = bb75163e-76bf-479c-8891-815840b98e5a response_code = 204 uri = /omicron-zones
7822024-11-19T19:37:17.434ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7832024-11-19T19:37:17.464ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7842024-11-19T19:37:17.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60262
7852024-11-19T19:37:17.472ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
7862024-11-19T19:37:17.472ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 7994 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60262 req_id = 39ce5e22-2957-42ca-aa69-3c20848ca8de response_code = 500 uri = /timesync
7872024-11-19T19:37:17.474ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7882024-11-19T19:37:17.583ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7892024-11-19T19:37:17.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62691
7902024-11-19T19:37:19.062ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2908875181242270937 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
7912024-11-19T19:37:19.955ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16903217827235612371 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
7922024-11-19T19:37:20.143ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16052207112756497384 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
7932024-11-19T19:37:20.850ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7505803311932058612 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
7942024-11-19T19:37:20.850ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16187920963863030048 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
7952024-11-19T19:37:21.592ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_2ab43afe-f1ba-4f64-b73a-00dab8ed52ed': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
7962024-11-19T19:37:21.592ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008838 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62691 req_id = d89e9a62-35f7-41a8-87b0-08d4d939787e response_code = 500 uri = /timesync
7972024-11-19T19:37:21.595ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7982024-11-19T19:37:21.761ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7992024-11-19T19:37:21.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50151
8002024-11-19T19:37:21.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8511 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50151 req_id = 52286927-3193-4557-b977-946ca5e1918e response_code = 200 uri = /timesync
8012024-11-19T19:37:21.772ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8022024-11-19T19:37:21.772ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8032024-11-19T19:37:22.002ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8042024-11-19T19:37:22.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48037
8052024-11-19T19:37:22.007ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 633340610555715702 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
8062024-11-19T19:37:22.007ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14499540168669099160 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
8072024-11-19T19:37:22.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48037 req_id = 408ebf81-2e39-4e6a-b96d-1235b4114285 response_code = 200 uri = /timesync
8082024-11-19T19:37:22.014ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8092024-11-19T19:37:22.014ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8102024-11-19T19:37:22.295ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8112024-11-19T19:37:22.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46161
8122024-11-19T19:37:22.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7761 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46161 req_id = f00ace4d-5fcb-47cf-828c-386178b924dd response_code = 200 uri = /timesync
8132024-11-19T19:37:22.304ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8142024-11-19T19:37:22.304ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8152024-11-19T19:37:22.491ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8162024-11-19T19:37:22.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58056
8172024-11-19T19:37:22.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7848 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58056 req_id = 377f6294-b161-4766-9906-a164171ab1d3 response_code = 200 uri = /timesync
8182024-11-19T19:37:22.500ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8192024-11-19T19:37:22.500ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8202024-11-19T19:37:22.765ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8212024-11-19T19:37:22.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38765
8222024-11-19T19:37:22.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38765 req_id = ae31c115-e880-426e-9c64-aa9d0aab9e80 response_code = 200 uri = /timesync
8232024-11-19T19:37:22.774ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8242024-11-19T19:37:22.774ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8252024-11-19T19:37:23.172ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8262024-11-19T19:37:23.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55064
8272024-11-19T19:37:23.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7820 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55064 req_id = 11e979d3-8f02-4da4-8f2e-1791a4c59f23 response_code = 200 uri = /timesync
8282024-11-19T19:37:23.181ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8292024-11-19T19:37:23.181ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8302024-11-19T19:37:23.342ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8312024-11-19T19:37:23.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51705
8322024-11-19T19:37:23.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8408 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51705 req_id = 993a23f0-5ebf-4116-9783-163e74ffe71b response_code = 200 uri = /timesync
8332024-11-19T19:37:23.352ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8342024-11-19T19:37:23.352ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8352024-11-19T19:37:24.198ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8362024-11-19T19:37:24.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39789
8372024-11-19T19:37:24.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9005 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39789 req_id = df7aec70-a909-491a-a022-50ba296f9b22 response_code = 200 uri = /timesync
8382024-11-19T19:37:24.208ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8392024-11-19T19:37:24.208ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8402024-11-19T19:37:24.658ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8412024-11-19T19:37:24.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50522
8422024-11-19T19:37:24.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10333 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50522 req_id = d7a8bfdf-f8a9-4327-b8fb-306c051847da response_code = 200 uri = /timesync
8432024-11-19T19:37:24.670ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045044.2842336, correction: -0.330726743 } file = sled-agent/src/rack_setup/service.rs:740
8442024-11-19T19:37:24.670ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8452024-11-19T19:37:25.251ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8462024-11-19T19:37:25.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50296
8472024-11-19T19:37:25.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7469 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50296 req_id = a576a25c-0728-4fd9-bf66-32ba5576290d response_code = 200 uri = /timesync
8482024-11-19T19:37:25.261ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732045043.3675766, correction: -0.340718567 } file = sled-agent/src/rack_setup/service.rs:740
8492024-11-19T19:37:25.261ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8502024-11-19T19:37:25.697ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 319.161504ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
8512024-11-19T19:37:25.859ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8522024-11-19T19:37:25.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64292
8532024-11-19T19:37:25.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8636 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64292 req_id = 5b65505e-1a6e-438f-b656-57d771c33580 response_code = 200 uri = /timesync
8542024-11-19T19:37:25.870ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732045043.3675766, correction: -0.326414943 } file = sled-agent/src/rack_setup/service.rs:740
8552024-11-19T19:37:25.870ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8562024-11-19T19:37:27.109ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8572024-11-19T19:37:27.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53870
8582024-11-19T19:37:27.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8049 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53870 req_id = d56cea82-0850-4d13-84a7-df581c807619 response_code = 200 uri = /timesync
8592024-11-19T19:37:27.120ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732045043.3675766, correction: -0.322773606 } file = sled-agent/src/rack_setup/service.rs:740
8602024-11-19T19:37:27.120ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8612024-11-19T19:37:27.596ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7652939723448010421 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
8622024-11-19T19:37:27.596ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4860324990986843141 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
8632024-11-19T19:37:28.238ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8642024-11-19T19:37:28.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38302
8652024-11-19T19:37:28.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8434 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38302 req_id = 3b8983e7-af71-41bb-b96f-1b6a42a00b19 response_code = 200 uri = /timesync
8662024-11-19T19:37:28.249ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045046.5285113, correction: -0.319393009 } file = sled-agent/src/rack_setup/service.rs:740
8672024-11-19T19:37:28.249ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8682024-11-19T19:37:29.221ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2908875181242270937 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
8692024-11-19T19:37:29.975ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8702024-11-19T19:37:29.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44612
8712024-11-19T19:37:29.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7777 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44612 req_id = 7b224ab8-842a-4f40-b011-fa245fa54c0f response_code = 200 uri = /timesync
8722024-11-19T19:37:29.985ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045048.5301623, correction: -0.313689679 } file = sled-agent/src/rack_setup/service.rs:740
8732024-11-19T19:37:29.985ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8742024-11-19T19:37:30.110ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16903217827235612371 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
8752024-11-19T19:37:30.297ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16052207112756497384 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
8762024-11-19T19:37:30.817ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8772024-11-19T19:37:30.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52687
8782024-11-19T19:37:30.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52687 req_id = 04331474-0ac9-4f96-bd8c-dcaa50c8fbee response_code = 200 uri = /timesync
8792024-11-19T19:37:30.829ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045049.5305836, correction: -0.311133504 } file = sled-agent/src/rack_setup/service.rs:740
8802024-11-19T19:37:30.829ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8812024-11-19T19:37:30.911ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44780
8822024-11-19T19:37:30.911ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44780 req_id = 85f3bfea-fbb6-40d9-8d0b-49e92717d09a response_code = 200 uri = /baseboard
8832024-11-19T19:37:31.004ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7505803311932058612 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
8842024-11-19T19:37:31.004ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16187920963863030048 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
8852024-11-19T19:37:32.157ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 633340610555715702 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
8862024-11-19T19:37:32.157ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14499540168669099160 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
8872024-11-19T19:37:32.331ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8882024-11-19T19:37:32.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43294
8892024-11-19T19:37:32.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43294 req_id = 5dbf0c3c-f349-43d0-8af7-accb04b36d1f response_code = 200 uri = /timesync
8902024-11-19T19:37:32.343ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045050.4743922, correction: -0.30701381 } file = sled-agent/src/rack_setup/service.rs:740
8912024-11-19T19:37:32.343ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8922024-11-19T19:37:34.862ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8932024-11-19T19:37:34.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39263
8942024-11-19T19:37:34.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8607 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39263 req_id = 7aad54eb-90dd-47d2-9b74-22a85c5ea744 response_code = 200 uri = /timesync
8952024-11-19T19:37:34.873ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045053.979236, correction: -0.300061911 } file = sled-agent/src/rack_setup/service.rs:740
8962024-11-19T19:37:34.873ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8972024-11-19T19:37:37.365ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8982024-11-19T19:37:37.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46328
8992024-11-19T19:37:37.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8620 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46328 req_id = b0a83f2e-5fdf-4c00-a2cc-cdb8e5949bf1 response_code = 200 uri = /timesync
9002024-11-19T19:37:37.378ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045056.4448872, correction: -0.293268323 } file = sled-agent/src/rack_setup/service.rs:740
9012024-11-19T19:37:37.378ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9022024-11-19T19:37:37.570ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7652939723448010421 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9032024-11-19T19:37:37.570ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4860324990986843141 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9042024-11-19T19:37:39.196ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2908875181242270937 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9052024-11-19T19:37:40.085ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16903217827235612371 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9062024-11-19T19:37:40.271ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16052207112756497384 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9072024-11-19T19:37:40.979ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7505803311932058612 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9082024-11-19T19:37:40.980ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16187920963863030048 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9092024-11-19T19:37:41.008ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 504.342215ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9102024-11-19T19:37:41.920ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9112024-11-19T19:37:41.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41163
9122024-11-19T19:37:41.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8871 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41163 req_id = 28fb428c-972c-425f-bffe-5ce93e44e87a response_code = 200 uri = /timesync
9132024-11-19T19:37:41.932ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045061.067715, correction: -0.280828357 } file = sled-agent/src/rack_setup/service.rs:740
9142024-11-19T19:37:41.932ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9152024-11-19T19:37:42.133ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 633340610555715702 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9162024-11-19T19:37:42.133ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14499540168669099160 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9172024-11-19T19:37:45.405ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9182024-11-19T19:37:45.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45358
9192024-11-19T19:37:45.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8744 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45358 req_id = 535b3997-9b33-485c-b24f-ed1ba8f4dddb response_code = 200 uri = /timesync
9202024-11-19T19:37:45.416ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045062.0964575, correction: -0.271358907 } file = sled-agent/src/rack_setup/service.rs:740
9212024-11-19T19:37:45.416ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9222024-11-19T19:37:47.546ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7652939723448010421 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9232024-11-19T19:37:47.546ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4860324990986843141 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9242024-11-19T19:37:48.273ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9252024-11-19T19:37:48.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60844
9262024-11-19T19:37:48.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8964 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60844 req_id = 29c27f18-383b-4c71-808c-047f9089f008 response_code = 200 uri = /timesync
9272024-11-19T19:37:48.284ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045067.2275453, correction: -0.263602465 } file = sled-agent/src/rack_setup/service.rs:740
9282024-11-19T19:37:48.284ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9292024-11-19T19:37:49.171ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2908875181242270937 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9302024-11-19T19:37:50.061ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16903217827235612371 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9312024-11-19T19:37:50.245ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16052207112756497384 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9322024-11-19T19:37:50.954ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 7505803311932058612 reason = Duration(60s) sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9332024-11-19T19:37:50.954ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16187920963863030048 reason = Duration(60s) sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9342024-11-19T19:37:51.460ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9352024-11-19T19:37:51.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59378
9362024-11-19T19:37:51.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8345 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59378 req_id = 9e5684d7-9be2-42c4-8311-dbe9af635f69 response_code = 200 uri = /timesync
9372024-11-19T19:37:51.470ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045070.0096576, correction: -0.254964858 } file = sled-agent/src/rack_setup/service.rs:740
9382024-11-19T19:37:51.470ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9392024-11-19T19:37:52.108ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 633340610555715702 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9402024-11-19T19:37:52.108ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14499540168669099160 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9412024-11-19T19:37:56.504ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.169397272s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9422024-11-19T19:37:57.520ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7652939723448010421 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9432024-11-19T19:37:57.520ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4860324990986843141 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9442024-11-19T19:37:59.146ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2908875181242270937 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9452024-11-19T19:37:59.773ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9462024-11-19T19:37:59.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51998
9472024-11-19T19:37:59.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8630 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51998 req_id = 071ca509-e93e-4eec-989f-ae73a5aba214 response_code = 200 uri = /timesync
9482024-11-19T19:37:59.786ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045078.3835144, correction: -0.233917415 } file = sled-agent/src/rack_setup/service.rs:740
9492024-11-19T19:37:59.786ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9502024-11-19T19:38:00.035ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16903217827235612371 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9512024-11-19T19:38:00.220ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16052207112756497384 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9522024-11-19T19:38:00.864ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43732
9532024-11-19T19:38:00.864ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43732 req_id = c54186af-5185-4eac-9803-f7c58e1e135e response_code = 200 uri = /baseboard
9542024-11-19T19:38:02.082ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 633340610555715702 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9552024-11-19T19:38:02.082ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14499540168669099160 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9562024-11-19T19:38:07.495ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7652939723448010421 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9572024-11-19T19:38:07.495ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4860324990986843141 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9582024-11-19T19:38:08.866ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9592024-11-19T19:38:08.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56976
9602024-11-19T19:38:08.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8871 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56976 req_id = 7c23fc1b-99be-4968-b47c-293f572c7dce response_code = 200 uri = /timesync
9612024-11-19T19:38:08.877ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045086.5465517, correction: -0.209271446 } file = sled-agent/src/rack_setup/service.rs:740
9622024-11-19T19:38:08.877ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9632024-11-19T19:38:09.122ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 2908875181242270937 reason = Duration(60s) sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9642024-11-19T19:38:10.010ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16903217827235612371 reason = Duration(60s) sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9652024-11-19T19:38:10.194ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16052207112756497384 reason = Duration(60s) sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9662024-11-19T19:38:12.058ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 633340610555715702 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9672024-11-19T19:38:12.058ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14499540168669099160 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9682024-11-19T19:38:12.663ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.422620354s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9692024-11-19T19:38:15.849ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9702024-11-19T19:38:15.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42470
9712024-11-19T19:38:15.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9376 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42470 req_id = fe759675-0f19-43b3-a8c0-741b42f22ac1 response_code = 200 uri = /timesync
9722024-11-19T19:38:15.861ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045094.571197, correction: -0.190297082 } file = sled-agent/src/rack_setup/service.rs:740
9732024-11-19T19:38:15.861ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9742024-11-19T19:38:17.470ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 7652939723448010421 reason = Duration(60s) sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9752024-11-19T19:38:17.471ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4860324990986843141 reason = Duration(60s) sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9762024-11-19T19:38:22.032ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 633340610555715702 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9772024-11-19T19:38:22.033ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14499540168669099160 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9782024-11-19T19:38:28.807ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9792024-11-19T19:38:28.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55595
9802024-11-19T19:38:28.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8910 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55595 req_id = 345e5365-1d96-4e6b-ae54-4565113484c9 response_code = 200 uri = /timesync
9812024-11-19T19:38:28.819ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045103.0746322, correction: -0.15511243 } file = sled-agent/src/rack_setup/service.rs:740
9822024-11-19T19:38:28.819ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9832024-11-19T19:38:29.075ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.327747583s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9842024-11-19T19:38:30.817ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61972
9852024-11-19T19:38:30.817ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61972 req_id = 0a5afc8a-c6e0-4a89-820a-fd33318459c1 response_code = 200 uri = /baseboard
9862024-11-19T19:38:32.007ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 633340610555715702 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9872024-11-19T19:38:32.007ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14499540168669099160 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9882024-11-19T19:38:41.983ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 633340610555715702 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9892024-11-19T19:38:41.983ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14499540168669099160 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9902024-11-19T19:38:42.277ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9912024-11-19T19:38:42.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65401
9922024-11-19T19:38:42.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9372 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65401 req_id = 5e0c96b3-a0fa-4631-91bd-f6f484973316 response_code = 200 uri = /timesync
9932024-11-19T19:38:42.289ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045118.7138972, correction: -0.118537292 } file = sled-agent/src/rack_setup/service.rs:740
9942024-11-19T19:38:42.289ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9952024-11-19T19:38:49.384ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 7.514365405s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9962024-11-19T19:38:51.957ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 633340610555715702 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9972024-11-19T19:38:51.957ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14499540168669099160 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
9982024-11-19T19:38:53.528ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9992024-11-19T19:38:53.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54803
10002024-11-19T19:38:53.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9418 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54803 req_id = 30b2c52d-e356-4bf9-917b-451888a2fd4a response_code = 200 uri = /timesync
10012024-11-19T19:38:53.540ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045126.6475055, correction: -0.08799915 } file = sled-agent/src/rack_setup/service.rs:740
10022024-11-19T19:38:53.540ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
10032024-11-19T19:39:00.768ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43465
10042024-11-19T19:39:00.768ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43465 req_id = 40bd5876-25c4-4f1c-ac5d-b53cedfe45ca response_code = 200 uri = /baseboard
10052024-11-19T19:39:01.933ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 633340610555715702 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
10062024-11-19T19:39:01.933ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14499540168669099160 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
10072024-11-19T19:39:03.813ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10082024-11-19T19:39:03.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53654
10092024-11-19T19:39:03.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8512 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53654 req_id = a506cae3-bed4-42f9-8304-49f1e7be31ac response_code = 200 uri = /timesync
10102024-11-19T19:39:03.824ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045143.105829, correction: -0.060145631 } file = sled-agent/src/rack_setup/service.rs:740
10112024-11-19T19:39:03.824ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
10122024-11-19T19:39:11.873ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 12.126995815s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
10132024-11-19T19:39:11.908ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 633340610555715702 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
10142024-11-19T19:39:11.908ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14499540168669099160 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
10152024-11-19T19:39:21.882ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 633340610555715702 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
10162024-11-19T19:39:21.883ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14499540168669099160 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
10172024-11-19T19:39:30.274ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10182024-11-19T19:39:30.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65014
10192024-11-19T19:39:30.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65014 req_id = ab2d8fd5-81f3-4958-b94f-a540aa2da7eb response_code = 200 uri = /timesync
10202024-11-19T19:39:30.298ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-19T19:38:10.194516743Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16052207112756497384 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
10212024-11-19T19:39:30.298ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-19T19:38:17.470585245Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 7652939723448010421 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
10222024-11-19T19:39:30.299ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-19T19:38:17.471034007Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4860324990986843141 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
10232024-11-19T19:39:30.299ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-19T19:38:09.122611983Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 2908875181242270937 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
10242024-11-19T19:39:30.299ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-19T19:38:10.010595368Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16903217827235612371 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
10252024-11-19T19:39:30.300ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-19T19:37:50.954875083Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16187920963863030048 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
10262024-11-19T19:39:30.300ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-19T19:37:50.954385519Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 7505803311932058612 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
10272024-11-19T19:39:30.300ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1732045167.107465, correction: 1.59e-7 } file = sled-agent/src/rack_setup/service.rs:740
10282024-11-19T19:39:30.300ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1425
10292024-11-19T19:39:30.330ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 216d60cb-f227-4c7a-8ea8-b35a2477da58 (service), filesystem_pool: Some(ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: dc2135a1-6478-49d7-9c9f-6c155521750c (service), filesystem_pool: Some(ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 5ab01216-071b-4591-a0de-d5e1c8dacc5a (service), filesystem_pool: Some(ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 2ab43afe-f1ba-4f64-b73a-00dab8ed52ed (service), filesystem_pool: Some(ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 89fdd5c9-2720-410c-bc95-a64cd3087b4a, kind: Service { id: 2ab43afe-f1ba-4f64-b73a-00dab8ed52ed }, name: Name("ntp-2ab43afe-f1ba-4f64-b73a-00dab8ed52ed"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 1])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: a97bf873-533a-45d4-9c53-c1e81d7f6a5d (service), filesystem_pool: Some(ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External } } } }, OmicronZoneConfig { id: 009de0d7-e944-4045-a53e-565a499d314d (service), filesystem_pool: Some(ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9453e8d1-a1f5-4bda-abab-88223fd26ad6 (service), filesystem_pool: Some(ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External } } } }, OmicronZoneConfig { id: 25e7d929-048e-4c77-9812-0afe99fb4b2b (service), filesystem_pool: Some(ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7654436e-b4bd-43cb-b311-776b69aba383 (service), filesystem_pool: Some(ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10302024-11-19T19:39:30.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35836
10312024-11-19T19:39:30.330ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10322024-11-19T19:39:30.330ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json file = common/src/ledger.rs:178
10332024-11-19T19:39:30.331ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json file = common/src/ledger.rs:178
10342024-11-19T19:39:30.331ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
10352024-11-19T19:39:30.331ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
10362024-11-19T19:39:30.331ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
10372024-11-19T19:39:30.331ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
10382024-11-19T19:39:30.331ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10392024-11-19T19:39:30.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10402024-11-19T19:39:30.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10412024-11-19T19:39:30.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10422024-11-19T19:39:30.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10432024-11-19T19:39:30.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10442024-11-19T19:39:30.509ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6 file = illumos-utils/src/zone.rs:325
10452024-11-19T19:39:30.513ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b file = illumos-utils/src/zone.rs:325
10462024-11-19T19:39:30.517ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d file = illumos-utils/src/zone.rs:325
10472024-11-19T19:39:30.522ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d file = illumos-utils/src/zone.rs:325
10482024-11-19T19:39:30.527ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383 file = illumos-utils/src/zone.rs:325
10492024-11-19T19:39:30.531ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6 file = illumos-utils/src/zone.rs:363
10502024-11-19T19:39:30.536ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b file = illumos-utils/src/zone.rs:363
10512024-11-19T19:39:30.541ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d file = illumos-utils/src/zone.rs:363
10522024-11-19T19:39:30.545ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d file = illumos-utils/src/zone.rs:363
10532024-11-19T19:39:30.550ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383 file = illumos-utils/src/zone.rs:363
10542024-11-19T19:39:30.752ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64109
10552024-11-19T19:39:30.752ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64109 req_id = 7e5d2bf2-84dc-4ec6-ae42-b05094534fba response_code = 200 uri = /baseboard
10562024-11-19T19:39:33.516ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a97bf873-533a-45d4-9c53-c1e81d7f6a5d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10572024-11-19T19:39:33.517ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='25e7d929-048e-4c77-9812-0afe99fb4b2b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10582024-11-19T19:39:33.517ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d
10592024-11-19T19:39:33.523ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
10602024-11-19T19:39:33.528ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='009de0d7-e944-4045-a53e-565a499d314d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10612024-11-19T19:39:33.528ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='9453e8d1-a1f5-4bda-abab-88223fd26ad6'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10622024-11-19T19:39:33.528ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
10632024-11-19T19:39:33.533ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
10642024-11-19T19:39:33.544ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7654436e-b4bd-43cb-b311-776b69aba383'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10652024-11-19T19:39:33.544ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383
10662024-11-19T19:39:33.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d") failed: Property not found. retry in 66.108249ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d
10672024-11-19T19:39:33.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 58.740716ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
10682024-11-19T19:39:33.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6") failed: Property not found. retry in 65.556441ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
10692024-11-19T19:39:33.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b") failed: Property not found. retry in 40.329628ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
10702024-11-19T19:39:33.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383") failed: Property not found. retry in 26.678297ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383
10712024-11-19T19:39:33.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383") failed: Property not found. retry in 134.795216ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383
10722024-11-19T19:39:34.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b") failed: Property not found. retry in 132.566739ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
10732024-11-19T19:39:34.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 74.075486ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
10742024-11-19T19:39:34.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d") failed: Property not found. retry in 55.841756ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d
10752024-11-19T19:39:34.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6") failed: Property not found. retry in 62.748182ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
10762024-11-19T19:39:34.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b") failed: Property not found. retry in 143.060313ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
10772024-11-19T19:39:35.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 217.374895ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
10782024-11-19T19:39:35.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d") failed: Property not found. retry in 291.307657ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d
10792024-11-19T19:39:35.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383") failed: Property not found. retry in 213.82858ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383
10802024-11-19T19:39:35.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6") failed: Property not found. retry in 126.429815ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
10812024-11-19T19:39:35.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b") failed: Property not found. retry in 432.266917ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
10822024-11-19T19:39:35.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6") failed: Property not found. retry in 444.50665ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
10832024-11-19T19:39:35.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 493.494266ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
10842024-11-19T19:39:35.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383") failed: Property not found. retry in 267.095148ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383
10852024-11-19T19:39:35.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d") failed: Property not found. retry in 563.532609ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d
10862024-11-19T19:39:35.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383") failed: Property not found. retry in 1.007904689s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383
10872024-11-19T19:39:35.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b") failed: Property not found. retry in 514.155561ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
10882024-11-19T19:39:35.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6") failed: Property not found. retry in 846.0149ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
10892024-11-19T19:39:35.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 979.999428ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
10902024-11-19T19:39:35.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d") failed: Property not found. retry in 535.657954ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d
10912024-11-19T19:39:36.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b") failed: Property not found. retry in 665.834564ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
10922024-11-19T19:39:36.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d") failed: Property not found. retry in 866.648919ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d
10932024-11-19T19:39:36.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6") failed: Property not found. retry in 507.105057ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
10942024-11-19T19:39:36.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383") failed: Property not found. retry in 529.115305ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383
10952024-11-19T19:39:36.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 569.64822ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
10962024-11-19T19:39:36.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b") failed: Property not found. retry in 637.74879ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
10972024-11-19T19:39:37.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6") failed: Property not found. retry in 503.221118ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
10982024-11-19T19:39:37.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383") failed: Property not found. retry in 1.281867325s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383
10992024-11-19T19:39:37.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 607.560712ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
11002024-11-19T19:39:37.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d") failed: Property not found. retry in 580.554876ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d
11012024-11-19T19:39:37.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b") failed: Property not found. retry in 947.269054ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
11022024-11-19T19:39:37.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6") failed: Property not found. retry in 1.40561927s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
11032024-11-19T19:39:37.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d") failed: Property not found. retry in 1.01558554s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d
11042024-11-19T19:39:37.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 776.329499ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
11052024-11-19T19:39:38.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383") failed: Property not found. retry in 1.2773337s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383
11062024-11-19T19:39:38.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b") failed: Property not found. retry in 746.102061ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
11072024-11-19T19:39:38.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 585.699807ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
11082024-11-19T19:39:38.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d") failed: Property not found. retry in 1.336873308s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d
11092024-11-19T19:39:38.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6") failed: Property not found. retry in 995.811512ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
11102024-11-19T19:39:38.998ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 28.255673632s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
11112024-11-19T19:39:39.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b") failed: Property not found. retry in 1.363192622s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
11122024-11-19T19:39:39.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 1.277560399s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
11132024-11-19T19:39:39.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383") failed: Property not found. retry in 915.55522ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383
11142024-11-19T19:39:39.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6") failed: Property not found. retry in 982.99474ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
11152024-11-19T19:39:40.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d") failed: Property not found. retry in 1.438719051s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d
11162024-11-19T19:39:40.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b") failed: Property not found. retry in 589.982692ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
11172024-11-19T19:39:40.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383") failed: Property not found. retry in 584.111164ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383
11182024-11-19T19:39:40.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 675.907495ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
11192024-11-19T19:39:40.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6") failed: Property not found. retry in 668.984255ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
11202024-11-19T19:39:41.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b") failed: Property not found. retry in 1.243907275s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
11212024-11-19T19:39:41.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383") failed: Property not found. retry in 1.375894557s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383
11222024-11-19T19:39:41.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 968.212015ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
11232024-11-19T19:39:41.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6") failed: Property not found. retry in 1.095689843s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
11242024-11-19T19:39:41.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d") failed: Property not found. retry in 1.254722664s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d
11252024-11-19T19:39:42.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 784.431953ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
11262024-11-19T19:39:42.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b") failed: Property not found. retry in 852.70857ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
11272024-11-19T19:39:42.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383") failed: Property not found. retry in 1.208673837s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383
11282024-11-19T19:39:42.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6") failed: Property not found. retry in 911.020821ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
11292024-11-19T19:39:43.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d") failed: Property not found. retry in 877.576072ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d
11302024-11-19T19:39:43.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 591.781196ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
11312024-11-19T19:39:43.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b") failed: Property not found. retry in 949.342034ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
11322024-11-19T19:39:43.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6") failed: Property not found. retry in 562.825599ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
11332024-11-19T19:39:43.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 979.838387ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
11342024-11-19T19:39:43.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383") failed: Property not found. retry in 1.316918494s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383
11352024-11-19T19:39:43.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d") failed: Property not found. retry in 957.37221ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d
11362024-11-19T19:39:44.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b") failed: Property not found. retry in 700.296837ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
11372024-11-19T19:39:44.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6") failed: Property not found. retry in 1.270344938s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
11382024-11-19T19:39:44.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 1.317271831s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
11392024-11-19T19:39:44.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d") failed: Property not found. retry in 1.330787672s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d
11402024-11-19T19:39:44.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b") failed: Property not found. retry in 1.188760699s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
11412024-11-19T19:39:45.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383") failed: Property not found. retry in 995.105437ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383
11422024-11-19T19:39:45.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6") failed: Property not found. retry in 1.029428028s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
11432024-11-19T19:39:45.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d") failed: Property not found. retry in 975.032335ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
11442024-11-19T19:39:46.994ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_9453e8d1-a1f5-4bda-abab-88223fd26ad6
11452024-11-19T19:39:46.994ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_25e7d929-048e-4c77-9812-0afe99fb4b2b
11462024-11-19T19:39:46.994ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d
11472024-11-19T19:39:46.994ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_a97bf873-533a-45d4-9c53-c1e81d7f6a5d
11482024-11-19T19:39:46.994ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_7654436e-b4bd-43cb-b311-776b69aba383
11492024-11-19T19:39:46.994ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
11502024-11-19T19:39:46.995ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json"
11512024-11-19T19:39:46.995ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
11522024-11-19T19:39:46.995ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json"
11532024-11-19T19:39:46.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16664912 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35836 req_id = a5856995-15a3-4528-8b2c-ccfa9446be87 response_code = 204 uri = /omicron-zones
11542024-11-19T19:39:47.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57669
11552024-11-19T19:39:47.059ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29272 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57669 req_id = 0cb3fc01-17f5-4bde-82ed-8af43ecb9a57 response_code = 500 uri = /cockroachdb
11562024-11-19T19:39:47.059ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0cb3fc01-17f5-4bde-82ed-8af43ecb9a57", "content-length": "124", "date": "Tue, 19 Nov 2024 19:39:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0cb3fc01-17f5-4bde-82ed-8af43ecb9a57" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 112.155835ms
11572024-11-19T19:39:47.201ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28506 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57669 req_id = 1ef87955-7705-463a-a3a9-c8a81eeaef0e response_code = 500 uri = /cockroachdb
11582024-11-19T19:39:47.201ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1ef87955-7705-463a-a3a9-c8a81eeaef0e", "content-length": "124", "date": "Tue, 19 Nov 2024 19:39:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1ef87955-7705-463a-a3a9-c8a81eeaef0e" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 145.391723ms
11592024-11-19T19:39:47.375ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28156 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57669 req_id = 80a7bde8-a47b-4de0-a338-7bca23762feb response_code = 500 uri = /cockroachdb
11602024-11-19T19:39:47.376ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "80a7bde8-a47b-4de0-a338-7bca23762feb", "content-length": "124", "date": "Tue, 19 Nov 2024 19:39:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "80a7bde8-a47b-4de0-a338-7bca23762feb" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 177.916013ms
11612024-11-19T19:39:47.581ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27219 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57669 req_id = 4c366a81-8c47-4ceb-8d80-3e9cad682a52 response_code = 500 uri = /cockroachdb
11622024-11-19T19:39:47.581ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4c366a81-8c47-4ceb-8d80-3e9cad682a52", "content-length": "124", "date": "Tue, 19 Nov 2024 19:39:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4c366a81-8c47-4ceb-8d80-3e9cad682a52" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 107.244811ms
11632024-11-19T19:39:47.717ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26077 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57669 req_id = 4abfe4d1-cc67-4494-b0ab-2ef34ba3b269 response_code = 500 uri = /cockroachdb
11642024-11-19T19:39:47.717ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4abfe4d1-cc67-4494-b0ab-2ef34ba3b269", "content-length": "124", "date": "Tue, 19 Nov 2024 19:39:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4abfe4d1-cc67-4494-b0ab-2ef34ba3b269" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 185.379844ms
11652024-11-19T19:39:47.929ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25561 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57669 req_id = 1d267966-af23-4973-b218-73617670fd82 response_code = 500 uri = /cockroachdb
11662024-11-19T19:39:47.929ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1d267966-af23-4973-b218-73617670fd82", "content-length": "124", "date": "Tue, 19 Nov 2024 19:39:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1d267966-af23-4973-b218-73617670fd82" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 222.957411ms
11672024-11-19T19:39:48.179ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25991 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57669 req_id = dfba4092-cf14-4c75-b394-441d4c01bfd1 response_code = 500 uri = /cockroachdb
11682024-11-19T19:39:48.180ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dfba4092-cf14-4c75-b394-441d4c01bfd1", "content-length": "124", "date": "Tue, 19 Nov 2024 19:39:48 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dfba4092-cf14-4c75-b394-441d4c01bfd1" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 383.319765ms
11692024-11-19T19:39:48.591ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27600 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57669 req_id = 5b023a12-ee6c-49f6-bd13-9b20c2bf9226 response_code = 500 uri = /cockroachdb
11702024-11-19T19:39:48.592ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5b023a12-ee6c-49f6-bd13-9b20c2bf9226", "content-length": "124", "date": "Tue, 19 Nov 2024 19:39:48 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5b023a12-ee6c-49f6-bd13-9b20c2bf9226" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 365.283804ms
11712024-11-19T19:39:48.986ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27652 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57669 req_id = 96b0cfe5-0b6e-4c29-895d-89aa0058ee84 response_code = 500 uri = /cockroachdb
11722024-11-19T19:39:48.986ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "96b0cfe5-0b6e-4c29-895d-89aa0058ee84", "content-length": "124", "date": "Tue, 19 Nov 2024 19:39:48 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "96b0cfe5-0b6e-4c29-895d-89aa0058ee84" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 276.544283ms
11732024-11-19T19:39:49.290ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26514 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57669 req_id = 09d7dc74-248b-44d8-b653-dde1f85453d0 response_code = 500 uri = /cockroachdb
11742024-11-19T19:39:49.290ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "09d7dc74-248b-44d8-b653-dde1f85453d0", "content-length": "124", "date": "Tue, 19 Nov 2024 19:39:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "09d7dc74-248b-44d8-b653-dde1f85453d0" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 371.435014ms
11752024-11-19T19:39:49.690ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_009de0d7-e944-4045-a53e-565a499d314d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28056 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57669 req_id = 48580f4a-0042-48b0-b315-fc7b97ebb069 response_code = 500 uri = /cockroachdb
11762024-11-19T19:39:49.691ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "48580f4a-0042-48b0-b315-fc7b97ebb069", "content-length": "124", "date": "Tue, 19 Nov 2024 19:39:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "48580f4a-0042-48b0-b315-fc7b97ebb069" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 497.741237ms
11772024-11-19T19:39:50.220ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3801
11782024-11-19T19:40:14.868ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3819
11792024-11-19T19:40:18.560ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3842
11802024-11-19T19:40:18.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28370811 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57669 req_id = fb2a1c5e-772a-4c67-82e6-18a64de8e8d1 response_code = 204 uri = /cockroachdb
11812024-11-19T19:40:18.561ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40922
11822024-11-19T19:40:18.684ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 216d60cb-f227-4c7a-8ea8-b35a2477da58 (service), filesystem_pool: Some(ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: dc2135a1-6478-49d7-9c9f-6c155521750c (service), filesystem_pool: Some(ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 5ab01216-071b-4591-a0de-d5e1c8dacc5a (service), filesystem_pool: Some(ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 2ab43afe-f1ba-4f64-b73a-00dab8ed52ed (service), filesystem_pool: Some(ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 89fdd5c9-2720-410c-bc95-a64cd3087b4a, kind: Service { id: 2ab43afe-f1ba-4f64-b73a-00dab8ed52ed }, name: Name("ntp-2ab43afe-f1ba-4f64-b73a-00dab8ed52ed"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 1])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: a97bf873-533a-45d4-9c53-c1e81d7f6a5d (service), filesystem_pool: Some(ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External } } } }, OmicronZoneConfig { id: 009de0d7-e944-4045-a53e-565a499d314d (service), filesystem_pool: Some(ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9453e8d1-a1f5-4bda-abab-88223fd26ad6 (service), filesystem_pool: Some(ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External } } } }, OmicronZoneConfig { id: 25e7d929-048e-4c77-9812-0afe99fb4b2b (service), filesystem_pool: Some(ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7654436e-b4bd-43cb-b311-776b69aba383 (service), filesystem_pool: Some(ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External } } } }, OmicronZoneConfig { id: b66ee542-3bb8-4a73-84f4-750c58e065cd (service), filesystem_pool: Some(ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 5b8bfa18-7354-4f55-a504-480af517e18d, kind: Service { id: b66ee542-3bb8-4a73-84f4-750c58e065cd }, name: Name("external-dns-b66ee542-3bb8-4a73-84f4-750c58e065cd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 138])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 6805754c-e76e-4239-8505-cec4433c6625 (service), filesystem_pool: Some(ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: e7dd645f-0047-411a-97d8-aca563c9c84b, kind: Service { id: 6805754c-e76e-4239-8505-cec4433c6625 }, name: Name("external-dns-6805754c-e76e-4239-8505-cec4433c6625"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 616e36c0-dd43-4cc2-ab3b-07823e2bc4d8 (service), filesystem_pool: Some(ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: a9d89c40-50f5-46df-aa3f-9729aafbd4c1, kind: Service { id: 616e36c0-dd43-4cc2-ab3b-07823e2bc4d8 }, name: Name("nexus-616e36c0-dd43-4cc2-ab3b-07823e2bc4d8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 55c1d4bf-7793-4af3-b4d3-e162197a6fc3 (service), filesystem_pool: Some(ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: ff3d55a5-b61f-48a6-b94d-766c7b25e0c2, kind: Service { id: 55c1d4bf-7793-4af3-b4d3-e162197a6fc3 }, name: Name("nexus-55c1d4bf-7793-4af3-b4d3-e162197a6fc3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 6880cb29-d555-4d40-84be-52baa0347d94 (service), filesystem_pool: Some(ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 3b3cb3e0-07fc-4857-ac35-656c692da813, kind: Service { id: 6880cb29-d555-4d40-84be-52baa0347d94 }, name: Name("nexus-6880cb29-d555-4d40-84be-52baa0347d94"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: de978b94-a70f-4779-892c-8ea3260e7a5e (service), filesystem_pool: Some(ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: d1a786d5-a3bc-47ae-839c-41e5c669cded (service), filesystem_pool: Some(ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External } } } }, OmicronZoneConfig { id: ef00869b-140c-486a-8a8a-8b64b6f3d7fe (service), filesystem_pool: Some(ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: d9d1ae13-4716-4771-90e6-8ecdc4c05c85 (service), filesystem_pool: Some(ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: fcb2f612-28f0-47ef-897a-def7e58073c4 (service), filesystem_pool: Some(ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 3b899e78-5a22-4524-bdc5-5b48be76c922 (service), filesystem_pool: Some(ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External } } } }, OmicronZoneConfig { id: 49f295e3-ca2a-47d4-89d2-4149b9f103ca (service), filesystem_pool: Some(ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External } } } }, OmicronZoneConfig { id: e3774459-cd71-4201-945b-422fa6090793 (service), filesystem_pool: Some(ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External } } } }, OmicronZoneConfig { id: 32b0278d-b5e0-48f7-97b1-7e59a0a057ad (service), filesystem_pool: Some(ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External } } } }, OmicronZoneConfig { id: d2869dcb-02ac-4b14-a79c-5e73e9f82137 (service), filesystem_pool: Some(ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External } } } }, OmicronZoneConfig { id: a238092b-0954-4096-883d-bda0dc7df516 (service), filesystem_pool: Some(ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External } } } }, OmicronZoneConfig { id: cef07d83-499b-4be2-b722-26ee3dd3e6b9 (service), filesystem_pool: Some(ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2dc55787-6af7-4852-9d52-5bcecccf75ec (service), filesystem_pool: Some(ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 40599e7f-8b43-4bdb-b180-416ff8515df2 (service), filesystem_pool: Some(ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
11832024-11-19T19:40:18.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63852
11842024-11-19T19:40:18.685ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11852024-11-19T19:40:18.685ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json file = common/src/ledger.rs:178
11862024-11-19T19:40:18.685ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json file = common/src/ledger.rs:178
11872024-11-19T19:40:18.685ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
11882024-11-19T19:40:18.685ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
11892024-11-19T19:40:18.686ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
11902024-11-19T19:40:18.686ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
11912024-11-19T19:40:18.686ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11922024-11-19T19:40:18.788ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11932024-11-19T19:40:18.814ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11942024-11-19T19:40:18.814ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11952024-11-19T19:40:18.861ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11962024-11-19T19:40:18.861ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11972024-11-19T19:40:18.861ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11982024-11-19T19:40:18.861ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11992024-11-19T19:40:18.861ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12002024-11-19T19:40:18.861ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12012024-11-19T19:40:18.861ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12022024-11-19T19:40:19.027ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12032024-11-19T19:40:19.106ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12042024-11-19T19:40:19.106ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12052024-11-19T19:40:19.107ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12062024-11-19T19:40:19.107ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12072024-11-19T19:40:19.107ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12082024-11-19T19:40:19.107ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12092024-11-19T19:40:19.107ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12102024-11-19T19:40:19.108ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12112024-11-19T19:40:19.109ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded file = illumos-utils/src/zone.rs:325
12122024-11-19T19:40:19.115ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e file = illumos-utils/src/zone.rs:325
12132024-11-19T19:40:19.121ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85 file = illumos-utils/src/zone.rs:325
12142024-11-19T19:40:19.127ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4 file = illumos-utils/src/zone.rs:325
12152024-11-19T19:40:19.132ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922 file = illumos-utils/src/zone.rs:325
12162024-11-19T19:40:19.137ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e3774459-cd71-4201-945b-422fa6090793 file = illumos-utils/src/zone.rs:325
12172024-11-19T19:40:19.142ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe file = illumos-utils/src/zone.rs:325
12182024-11-19T19:40:19.147ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca file = illumos-utils/src/zone.rs:325
12192024-11-19T19:40:19.276ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded file = illumos-utils/src/zone.rs:363
12202024-11-19T19:40:19.280ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e file = illumos-utils/src/zone.rs:363
12212024-11-19T19:40:19.285ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85 file = illumos-utils/src/zone.rs:363
12222024-11-19T19:40:19.289ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4 file = illumos-utils/src/zone.rs:363
12232024-11-19T19:40:19.293ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922 file = illumos-utils/src/zone.rs:363
12242024-11-19T19:40:19.298ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e3774459-cd71-4201-945b-422fa6090793 file = illumos-utils/src/zone.rs:363
12252024-11-19T19:40:19.302ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe file = illumos-utils/src/zone.rs:363
12262024-11-19T19:40:19.307ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca file = illumos-utils/src/zone.rs:363
12272024-11-19T19:40:19.312ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad file = illumos-utils/src/zone.rs:325
12282024-11-19T19:40:19.318ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137 file = illumos-utils/src/zone.rs:325
12292024-11-19T19:40:19.323ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9 file = illumos-utils/src/zone.rs:325
12302024-11-19T19:40:19.329ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2 file = illumos-utils/src/zone.rs:325
12312024-11-19T19:40:19.336ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516 file = illumos-utils/src/zone.rs:325
12322024-11-19T19:40:19.344ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec file = illumos-utils/src/zone.rs:325
12332024-11-19T19:40:19.353ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad file = illumos-utils/src/zone.rs:363
12342024-11-19T19:40:19.362ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137 file = illumos-utils/src/zone.rs:363
12352024-11-19T19:40:19.369ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9 file = illumos-utils/src/zone.rs:363
12362024-11-19T19:40:19.377ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2 file = illumos-utils/src/zone.rs:363
12372024-11-19T19:40:19.386ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516 file = illumos-utils/src/zone.rs:363
12382024-11-19T19:40:19.394ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec file = illumos-utils/src/zone.rs:363
12392024-11-19T19:40:19.462ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12402024-11-19T19:40:19.519ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12412024-11-19T19:40:19.577ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12422024-11-19T19:40:19.638ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12432024-11-19T19:40:19.694ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12442024-11-19T19:40:19.696ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12452024-11-19T19:40:19.696ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12462024-11-19T19:40:19.754ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 255, 35]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12472024-11-19T19:40:19.754ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
12482024-11-19T19:40:19.756ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12492024-11-19T19:40:19.756ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12502024-11-19T19:40:19.812ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 205, 138]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12512024-11-19T19:40:19.812ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = external_dns
12522024-11-19T19:40:19.813ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12532024-11-19T19:40:19.813ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12542024-11-19T19:40:19.869ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 167, 101]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12552024-11-19T19:40:19.869ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = external_dns
12562024-11-19T19:40:19.873ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12572024-11-19T19:40:19.873ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12582024-11-19T19:40:19.927ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 209, 132]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12592024-11-19T19:40:19.927ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
12602024-11-19T19:40:19.928ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12612024-11-19T19:40:19.928ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12622024-11-19T19:40:19.982ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 158, 194]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12632024-11-19T19:40:19.982ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
12642024-11-19T19:40:19.982ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
12652024-11-19T19:40:19.982ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
12662024-11-19T19:40:19.982ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
12672024-11-19T19:40:19.982ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
12682024-11-19T19:40:19.982ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
12692024-11-19T19:40:19.982ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
12702024-11-19T19:40:19.984ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
12712024-11-19T19:40:19.984ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
12722024-11-19T19:40:19.984ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
12732024-11-19T19:40:19.985ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
12742024-11-19T19:40:19.989ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
12752024-11-19T19:40:19.990ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
12762024-11-19T19:40:19.992ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
12772024-11-19T19:40:19.993ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12782024-11-19T19:40:19.993ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12792024-11-19T19:40:19.995ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12802024-11-19T19:40:19.995ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
12812024-11-19T19:40:19.997ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
12822024-11-19T19:40:20.018ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12832024-11-19T19:40:20.019ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12842024-11-19T19:40:20.259ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd file = illumos-utils/src/zone.rs:325
12852024-11-19T19:40:20.270ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3 file = illumos-utils/src/zone.rs:325
12862024-11-19T19:40:20.282ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94 file = illumos-utils/src/zone.rs:325
12872024-11-19T19:40:20.295ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8 file = illumos-utils/src/zone.rs:325
12882024-11-19T19:40:20.309ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625 file = illumos-utils/src/zone.rs:325
12892024-11-19T19:40:20.322ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd file = illumos-utils/src/zone.rs:363
12902024-11-19T19:40:20.333ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3 file = illumos-utils/src/zone.rs:363
12912024-11-19T19:40:20.349ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94 file = illumos-utils/src/zone.rs:363
12922024-11-19T19:40:20.358ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8 file = illumos-utils/src/zone.rs:363
12932024-11-19T19:40:20.367ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625 file = illumos-utils/src/zone.rs:363
12942024-11-19T19:40:23.756ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e3774459-cd71-4201-945b-422fa6090793: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_af234a87-284a-4af4-aac4-6b58ea279f05/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='11107720-9b7c-488d-84a0-be66101c2899'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12952024-11-19T19:40:23.756ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3cdbf8c9-3584-411d-8acb-3e587708315a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5d7818ac-abf5-4b59-ae0a-841ef6bd5a49'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12962024-11-19T19:40:23.756ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b5075ce0-4de0-43fe-a8e8-40bff047022b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='14163aca-5d38-4fcb-b3bd-edc3bc9766e7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12972024-11-19T19:40:23.756ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e3774459-cd71-4201-945b-422fa6090793 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
12982024-11-19T19:40:23.776ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='18b81730-d165-4453-9f43-b3e10176ff02'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12992024-11-19T19:40:23.776ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fa881b81-fb55-465b-a7d1-159614622ca4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f321db03-6536-443b-aa4d-97d12fd4fe71'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13002024-11-19T19:40:23.776ZINFOSledAgent (ServiceManager): Booting oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
13012024-11-19T19:40:23.787ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516
13022024-11-19T19:40:23.798ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
13032024-11-19T19:40:23.808ZINFOSledAgent (ServiceManager): Booting oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
13042024-11-19T19:40:24.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3774459-cd71-4201-945b-422fa6090793") failed: Property not found. retry in 58.673491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
13052024-11-19T19:40:24.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 46.368419ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
13062024-11-19T19:40:24.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9") failed: Property not found. retry in 71.025321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
13072024-11-19T19:40:24.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 52.704249ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
13082024-11-19T19:40:24.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516") failed: Property not found. retry in 32.932204ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516
13092024-11-19T19:40:24.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 88.868045ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
13102024-11-19T19:40:24.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3774459-cd71-4201-945b-422fa6090793") failed: Property not found. retry in 103.923601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
13112024-11-19T19:40:24.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516") failed: Property not found. retry in 118.598119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516
13122024-11-19T19:40:24.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9") failed: Property not found. retry in 120.728731ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
13132024-11-19T19:40:24.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 76.869087ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
13142024-11-19T19:40:24.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3774459-cd71-4201-945b-422fa6090793") failed: Property not found. retry in 131.881379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
13152024-11-19T19:40:24.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 189.505734ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
13162024-11-19T19:40:24.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516") failed: Property not found. retry in 233.432601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516
13172024-11-19T19:40:24.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 193.660047ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
13182024-11-19T19:40:24.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9") failed: Property not found. retry in 156.878849ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
13192024-11-19T19:40:24.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3774459-cd71-4201-945b-422fa6090793") failed: Property not found. retry in 597.477991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
13202024-11-19T19:40:24.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 353.256298ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
13212024-11-19T19:40:24.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9") failed: Property not found. retry in 467.981398ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
13222024-11-19T19:40:24.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 491.052147ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
13232024-11-19T19:40:24.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516") failed: Property not found. retry in 305.812595ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516
13242024-11-19T19:40:25.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 888.670759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
13252024-11-19T19:40:25.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516") failed: Property not found. retry in 781.672221ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516
13262024-11-19T19:40:25.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3774459-cd71-4201-945b-422fa6090793") failed: Property not found. retry in 414.73294ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
13272024-11-19T19:40:25.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9") failed: Property not found. retry in 1.081793579s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
13282024-11-19T19:40:25.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 523.64299ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
13292024-11-19T19:40:25.320ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5d346fc3-b1ff-469c-a353-925addba06e4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='097f7daf-e049-4dad-9db8-635f6a5b4619'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13302024-11-19T19:40:25.320ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec
13312024-11-19T19:40:25.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3774459-cd71-4201-945b-422fa6090793") failed: Property not found. retry in 1.225226639s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
13322024-11-19T19:40:25.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 890.807276ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
13332024-11-19T19:40:25.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516") failed: Property not found. retry in 1.00486036s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516
13342024-11-19T19:40:25.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 853.323186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
13352024-11-19T19:40:26.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9") failed: Property not found. retry in 534.262428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
13362024-11-19T19:40:26.412ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13372024-11-19T19:40:26.412ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85
13382024-11-19T19:40:26.460ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13392024-11-19T19:40:26.460ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe
13402024-11-19T19:40:26.619ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_be436df4-34a1-4101-90ff-be2f8ef7e824/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3d4b3cd6-e441-464e-9c2d-56da9e64c148'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13412024-11-19T19:40:26.619ZINFOSledAgent (ServiceManager): Booting oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
13422024-11-19T19:40:26.653ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a60d50c5-1d31-4171-ba2e-661c260a4561/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3de101c7-0409-47b8-ba04-2b191b726b9d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13432024-11-19T19:40:26.653ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
13442024-11-19T19:40:26.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 554.821628ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
13452024-11-19T19:40:26.680ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_43c663f2-b051-403e-bcad-e419348a9017/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2adec811-0a5c-4be6-8770-16873e6af9a4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13462024-11-19T19:40:26.680ZINFOSledAgent (ServiceManager): Booting oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad
13472024-11-19T19:40:26.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85") failed: Property not found. retry in 50.111749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85
13482024-11-19T19:40:26.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe") failed: Property not found. retry in 70.154987ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe
13492024-11-19T19:40:26.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85") failed: Property not found. retry in 88.433485ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85
13502024-11-19T19:40:26.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 1.18583612s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
13512024-11-19T19:40:26.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9") failed: Property not found. retry in 1.112829745s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
13522024-11-19T19:40:26.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3774459-cd71-4201-945b-422fa6090793") failed: Property not found. retry in 527.759445ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
13532024-11-19T19:40:26.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe") failed: Property not found. retry in 54.580997ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe
13542024-11-19T19:40:26.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516") failed: Property not found. retry in 1.067875879s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516
13552024-11-19T19:40:26.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca") failed: Property not found. retry in 53.319697ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
13562024-11-19T19:40:26.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85") failed: Property not found. retry in 260.792479ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85
13572024-11-19T19:40:26.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922") failed: Property not found. retry in 45.051329ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
13582024-11-19T19:40:26.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe") failed: Property not found. retry in 178.015892ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe
13592024-11-19T19:40:26.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca") failed: Property not found. retry in 126.198151ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
13602024-11-19T19:40:26.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad") failed: Property not found. retry in 56.899594ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad
13612024-11-19T19:40:26.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922") failed: Property not found. retry in 85.312734ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
13622024-11-19T19:40:27.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad") failed: Property not found. retry in 144.456408ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad
13632024-11-19T19:40:27.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922") failed: Property not found. retry in 210.28186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
13642024-11-19T19:40:27.093ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13652024-11-19T19:40:27.093ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13662024-11-19T19:40:27.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca") failed: Property not found. retry in 174.488593ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
13672024-11-19T19:40:27.105ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
13682024-11-19T19:40:27.114ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625
13692024-11-19T19:40:27.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe") failed: Property not found. retry in 303.458411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe
13702024-11-19T19:40:27.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85") failed: Property not found. retry in 541.254304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85
13712024-11-19T19:40:27.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad") failed: Property not found. retry in 194.077814ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad
13722024-11-19T19:40:27.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 1.33319242s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
13732024-11-19T19:40:27.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca") failed: Property not found. retry in 325.886999ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
13742024-11-19T19:40:27.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922") failed: Property not found. retry in 302.997467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
13752024-11-19T19:40:27.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd") failed: Property not found. retry in 70.819812ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
13762024-11-19T19:40:27.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625") failed: Property not found. retry in 68.781302ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625
13772024-11-19T19:40:27.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3774459-cd71-4201-945b-422fa6090793") failed: Property not found. retry in 1.319393882s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
13782024-11-19T19:40:27.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad") failed: Property not found. retry in 473.374547ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad
13792024-11-19T19:40:27.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd") failed: Property not found. retry in 58.11188ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
13802024-11-19T19:40:27.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625") failed: Property not found. retry in 117.986104ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625
13812024-11-19T19:40:27.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe") failed: Property not found. retry in 870.740593ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe
13822024-11-19T19:40:27.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625") failed: Property not found. retry in 119.345696ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625
13832024-11-19T19:40:27.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85") failed: Property not found. retry in 464.819056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85
13842024-11-19T19:40:27.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922") failed: Property not found. retry in 445.901228ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
13852024-11-19T19:40:27.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca") failed: Property not found. retry in 418.808623ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
13862024-11-19T19:40:27.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd") failed: Property not found. retry in 155.829229ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
13872024-11-19T19:40:27.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad") failed: Property not found. retry in 659.819277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad
13882024-11-19T19:40:27.913ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13892024-11-19T19:40:27.915ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4
13902024-11-19T19:40:27.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625") failed: Property not found. retry in 428.43799ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625
13912024-11-19T19:40:27.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516") failed: Property not found. retry in 1.216128671s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516
13922024-11-19T19:40:27.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9") failed: Property not found. retry in 855.554272ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
13932024-11-19T19:40:28.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 630.555546ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
13942024-11-19T19:40:28.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec") failed: Property not found. retry in 69.870288ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec
13952024-11-19T19:40:28.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd") failed: Property not found. retry in 372.761388ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
13962024-11-19T19:40:28.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec") failed: Property not found. retry in 128.582939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec
13972024-11-19T19:40:28.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4") failed: Property not found. retry in 54.642672ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4
13982024-11-19T19:40:28.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec") failed: Property not found. retry in 190.190867ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec
13992024-11-19T19:40:28.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca") failed: Property not found. retry in 546.860671ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
14002024-11-19T19:40:28.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85") failed: Property not found. retry in 515.379345ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85
14012024-11-19T19:40:28.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4") failed: Property not found. retry in 58.829305ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4
14022024-11-19T19:40:28.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922") failed: Property not found. retry in 774.164772ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
14032024-11-19T19:40:28.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625") failed: Property not found. retry in 1.126416698s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625
14042024-11-19T19:40:28.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4") failed: Property not found. retry in 159.629856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4
14052024-11-19T19:40:28.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd") failed: Property not found. retry in 1.003919405s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
14062024-11-19T19:40:28.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec") failed: Property not found. retry in 499.234323ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec
14072024-11-19T19:40:28.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4") failed: Property not found. retry in 599.805993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4
14082024-11-19T19:40:28.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad") failed: Property not found. retry in 534.756031ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad
14092024-11-19T19:40:28.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 1.313597067s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
14102024-11-19T19:40:28.647ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='de978b94-a70f-4779-892c-8ea3260e7a5e'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14112024-11-19T19:40:28.647ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e
14122024-11-19T19:40:28.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe") failed: Property not found. retry in 1.089827241s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe
14132024-11-19T19:40:28.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 1.023778601s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
14142024-11-19T19:40:28.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3774459-cd71-4201-945b-422fa6090793") failed: Property not found. retry in 1.494967429s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
14152024-11-19T19:40:28.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85") failed: Property not found. retry in 738.311737ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85
14162024-11-19T19:40:28.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca") failed: Property not found. retry in 1.419159402s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
14172024-11-19T19:40:28.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9") failed: Property not found. retry in 727.320073ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
14182024-11-19T19:40:28.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec") failed: Property not found. retry in 633.900342ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec
14192024-11-19T19:40:28.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e") failed: Property not found. retry in 34.121294ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e
14202024-11-19T19:40:29.011ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14212024-11-19T19:40:29.012ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14222024-11-19T19:40:29.012ZINFOSledAgent (ServiceManager): Booting oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
14232024-11-19T19:40:29.023ZINFOSledAgent (ServiceManager): Booting oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8
14242024-11-19T19:40:29.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e") failed: Property not found. retry in 134.249475ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e
14252024-11-19T19:40:29.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922") failed: Property not found. retry in 608.242966ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
14262024-11-19T19:40:29.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad") failed: Property not found. retry in 588.699992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad
14272024-11-19T19:40:29.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e") failed: Property not found. retry in 220.711519ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e
14282024-11-19T19:40:29.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4") failed: Property not found. retry in 718.39919ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4
14292024-11-19T19:40:29.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516") failed: Property not found. retry in 1.468057929s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516
14302024-11-19T19:40:29.346ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14312024-11-19T19:40:29.346ZINFOSledAgent (ServiceManager): Booting oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94
14322024-11-19T19:40:29.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3") failed: Property not found. retry in 44.132242ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
14332024-11-19T19:40:29.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8") failed: Property not found. retry in 41.563258ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8
14342024-11-19T19:40:29.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd") failed: Property not found. retry in 917.883823ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
14352024-11-19T19:40:29.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3") failed: Property not found. retry in 149.208937ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
14362024-11-19T19:40:29.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8") failed: Property not found. retry in 130.806194ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8
14372024-11-19T19:40:29.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625") failed: Property not found. retry in 544.988322ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625
14382024-11-19T19:40:29.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e") failed: Property not found. retry in 260.059906ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e
14392024-11-19T19:40:29.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94") failed: Property not found. retry in 39.933348ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94
14402024-11-19T19:40:29.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec") failed: Property not found. retry in 1.478483168s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec
14412024-11-19T19:40:29.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8") failed: Property not found. retry in 230.619723ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8
14422024-11-19T19:40:29.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3") failed: Property not found. retry in 226.437095ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
14432024-11-19T19:40:29.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85") failed: Property not found. retry in 829.195752ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85
14442024-11-19T19:40:29.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9") failed: Property not found. retry in 559.931402ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
14452024-11-19T19:40:29.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94") failed: Property not found. retry in 138.951818ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94
14462024-11-19T19:40:29.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 699.570881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
14472024-11-19T19:40:29.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922") failed: Property not found. retry in 937.506552ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
14482024-11-19T19:40:29.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe") failed: Property not found. retry in 684.346862ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe
14492024-11-19T19:40:29.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e") failed: Property not found. retry in 999.660549ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e
14502024-11-19T19:40:29.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94") failed: Property not found. retry in 265.841047ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94
14512024-11-19T19:40:29.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad") failed: Property not found. retry in 1.279699987s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad
14522024-11-19T19:40:29.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8") failed: Property not found. retry in 519.931051ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8
14532024-11-19T19:40:29.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3") failed: Property not found. retry in 271.640472ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
14542024-11-19T19:40:29.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 747.028099ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
14552024-11-19T19:40:30.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4") failed: Property not found. retry in 731.776778ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4
14562024-11-19T19:40:30.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625") failed: Property not found. retry in 689.659149ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625
14572024-11-19T19:40:30.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94") failed: Property not found. retry in 274.474035ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94
14582024-11-19T19:40:30.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3") failed: Property not found. retry in 483.366327ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
14592024-11-19T19:40:30.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3774459-cd71-4201-945b-422fa6090793") failed: Property not found. retry in 1.128692854s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
14602024-11-19T19:40:30.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9") failed: Property not found. retry in 1.378340255s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
14612024-11-19T19:40:30.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca") failed: Property not found. retry in 943.785407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
14622024-11-19T19:40:30.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd") failed: Property not found. retry in 1.148712627s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
14632024-11-19T19:40:30.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94") failed: Property not found. retry in 598.763645ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94
14642024-11-19T19:40:30.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8") failed: Property not found. retry in 798.420129ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8
14652024-11-19T19:40:30.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 1.214817922s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
14662024-11-19T19:40:30.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe") failed: Property not found. retry in 1.066289557s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe
14672024-11-19T19:40:30.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85") failed: Property not found. retry in 986.76443ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85
14682024-11-19T19:40:30.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3") failed: Property not found. retry in 562.324188ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
14692024-11-19T19:40:30.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922") failed: Property not found. retry in 978.113765ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
14702024-11-19T19:40:30.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 1.484314106s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
14712024-11-19T19:40:30.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625") failed: Property not found. retry in 1.429571069s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625
14722024-11-19T19:40:30.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4") failed: Property not found. retry in 1.072786875s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4
14732024-11-19T19:40:30.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516") failed: Property not found. retry in 809.201411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516
14742024-11-19T19:40:30.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e") failed: Property not found. retry in 1.031282345s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e
14752024-11-19T19:40:31.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94") failed: Property not found. retry in 908.105694ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94
14762024-11-19T19:40:31.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec") failed: Property not found. retry in 885.573783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec
14772024-11-19T19:40:31.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad") failed: Property not found. retry in 1.390134212s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad
14782024-11-19T19:40:31.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8") failed: Property not found. retry in 1.474547155s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8
14792024-11-19T19:40:31.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3") failed: Property not found. retry in 1.21268271s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
14802024-11-19T19:40:31.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca") failed: Property not found. retry in 771.828681ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
14812024-11-19T19:40:31.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3774459-cd71-4201-945b-422fa6090793") failed: Property not found. retry in 1.246784507s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
14822024-11-19T19:40:31.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85") failed: Property not found. retry in 640.861677ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85
14832024-11-19T19:40:31.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe") failed: Property not found. retry in 775.844761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe
14842024-11-19T19:40:31.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd") failed: Property not found. retry in 1.042131508s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
14852024-11-19T19:40:31.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516") failed: Property not found. retry in 1.32160963s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516
14862024-11-19T19:40:31.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9") failed: Property not found. retry in 1.463860058s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
14872024-11-19T19:40:31.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 651.312413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
14882024-11-19T19:40:31.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922") failed: Property not found. retry in 1.118908426s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
14892024-11-19T19:40:31.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4") failed: Property not found. retry in 570.112093ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4
14902024-11-19T19:40:31.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e") failed: Property not found. retry in 1.439957201s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e
14912024-11-19T19:40:31.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94") failed: Property not found. retry in 877.298163ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94
14922024-11-19T19:40:32.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec") failed: Property not found. retry in 1.385236432s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec
14932024-11-19T19:40:32.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca") failed: Property not found. retry in 912.304138ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
14942024-11-19T19:40:32.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85") failed: Property not found. retry in 962.561942ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85
14952024-11-19T19:40:32.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625") failed: Property not found. retry in 846.971831ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625
14962024-11-19T19:40:32.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 742.093245ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
14972024-11-19T19:40:32.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe") failed: Property not found. retry in 1.037654577s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe
14982024-11-19T19:40:32.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 863.320227ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
14992024-11-19T19:40:32.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4") failed: Property not found. retry in 1.340446147s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4
15002024-11-19T19:40:32.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3") failed: Property not found. retry in 889.85407ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
15012024-11-19T19:40:32.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad") failed: Property not found. retry in 579.858976ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad
15022024-11-19T19:40:32.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd") failed: Property not found. retry in 535.792241ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
15032024-11-19T19:40:32.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3774459-cd71-4201-945b-422fa6090793") failed: Property not found. retry in 1.331647854s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
15042024-11-19T19:40:32.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8") failed: Property not found. retry in 970.828202ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8
15052024-11-19T19:40:32.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94") failed: Property not found. retry in 1.329337703s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94
15062024-11-19T19:40:32.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922") failed: Property not found. retry in 1.052244978s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
15072024-11-19T19:40:33.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516") failed: Property not found. retry in 1.289775334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516
15082024-11-19T19:40:33.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 1.018621514s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
15092024-11-19T19:40:33.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca") failed: Property not found. retry in 881.809374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
15102024-11-19T19:40:33.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625") failed: Property not found. retry in 1.267466995s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625
15112024-11-19T19:40:33.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85") failed: Property not found. retry in 1.331207236s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85
15122024-11-19T19:40:33.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad") failed: Property not found. retry in 1.036855339s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad
15132024-11-19T19:40:33.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9") failed: Property not found. retry in 1.115035743s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
15142024-11-19T19:40:33.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd") failed: Property not found. retry in 967.160655ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
15152024-11-19T19:40:33.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 596.649675ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
15162024-11-19T19:40:33.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e") failed: Property not found. retry in 1.028739865s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e
15172024-11-19T19:40:33.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3") failed: Property not found. retry in 837.192458ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
15182024-11-19T19:40:33.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe") failed: Property not found. retry in 1.453780076s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe
15192024-11-19T19:40:33.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec") failed: Property not found. retry in 1.178688752s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec
15202024-11-19T19:40:33.688ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 62.409900554s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
15212024-11-19T19:40:33.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8") failed: Property not found. retry in 848.366896ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8
15222024-11-19T19:40:33.746ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15232024-11-19T19:40:33.746ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded
15242024-11-19T19:40:33.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4") failed: Property not found. retry in 903.326823ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4
15252024-11-19T19:40:33.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 1.041369553s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
15262024-11-19T19:40:33.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca") failed: Property not found. retry in 864.987067ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
15272024-11-19T19:40:33.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922") failed: Property not found. retry in 1.174854328s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
15282024-11-19T19:40:33.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded") failed: Property not found. retry in 28.471253ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded
15292024-11-19T19:40:34.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3774459-cd71-4201-945b-422fa6090793") failed: Property not found. retry in 1.324045598s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
15302024-11-19T19:40:34.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded") failed: Property not found. retry in 137.742266ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded
15312024-11-19T19:40:34.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 703.036588ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
15322024-11-19T19:40:34.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded") failed: Property not found. retry in 227.962452ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded
15332024-11-19T19:40:34.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd") failed: Property not found. retry in 1.164297723s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
15342024-11-19T19:40:34.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad") failed: Property not found. retry in 581.895019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad
15352024-11-19T19:40:34.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9") failed: Property not found. retry in 927.507945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
15362024-11-19T19:40:34.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516") failed: Property not found. retry in 935.008144ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516
15372024-11-19T19:40:34.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3") failed: Property not found. retry in 707.117349ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
15382024-11-19T19:40:34.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94") failed: Property not found. retry in 969.429596ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94
15392024-11-19T19:40:34.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded") failed: Property not found. retry in 460.376365ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded
15402024-11-19T19:40:34.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625") failed: Property not found. retry in 1.350786489s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625
15412024-11-19T19:40:34.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e") failed: Property not found. retry in 863.123176ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e
15422024-11-19T19:40:34.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85") failed: Property not found. retry in 1.168580881s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85
15432024-11-19T19:40:34.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8") failed: Property not found. retry in 596.587774ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8
15442024-11-19T19:40:34.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec") failed: Property not found. retry in 601.766703ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec
15452024-11-19T19:40:34.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4") failed: Property not found. retry in 726.71068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4
15462024-11-19T19:40:34.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 944.957992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
15472024-11-19T19:40:34.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca") failed: Property not found. retry in 662.724137ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
15482024-11-19T19:40:34.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe") failed: Property not found. retry in 703.916534ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe
15492024-11-19T19:40:34.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 1.094462157s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
15502024-11-19T19:40:34.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded") failed: Property not found. retry in 525.588661ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded
15512024-11-19T19:40:34.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad") failed: Property not found. retry in 929.778374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad
15522024-11-19T19:40:35.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922") failed: Property not found. retry in 1.110570632s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
15532024-11-19T19:40:35.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3") failed: Property not found. retry in 852.256384ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
15542024-11-19T19:40:35.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8") failed: Property not found. retry in 640.701877ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8
15552024-11-19T19:40:35.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec") failed: Property not found. retry in 1.001122686s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec
15562024-11-19T19:40:35.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3774459-cd71-4201-945b-422fa6090793") failed: Property not found. retry in 1.430710758s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
15572024-11-19T19:40:35.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9") failed: Property not found. retry in 1.365517519s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
15582024-11-19T19:40:35.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e") failed: Property not found. retry in 1.463160464s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e
15592024-11-19T19:40:35.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516") failed: Property not found. retry in 1.054841901s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516
15602024-11-19T19:40:35.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94") failed: Property not found. retry in 1.005970811s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94
15612024-11-19T19:40:35.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca") failed: Property not found. retry in 1.115340477s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
15622024-11-19T19:40:35.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4") failed: Property not found. retry in 1.221927296s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4
15632024-11-19T19:40:35.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded") failed: Property not found. retry in 528.840414ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded
15642024-11-19T19:40:35.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd") failed: Property not found. retry in 953.536397ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
15652024-11-19T19:40:35.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe") failed: Property not found. retry in 742.959705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe
15662024-11-19T19:40:35.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 1.029605723s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
15672024-11-19T19:40:35.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8") failed: Property not found. retry in 1.456583729s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8
15682024-11-19T19:40:35.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625") failed: Property not found. retry in 1.364049069s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625
15692024-11-19T19:40:35.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad") failed: Property not found. retry in 867.651155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad
15702024-11-19T19:40:36.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137") failed: Property not found. retry in 925.823303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
15712024-11-19T19:40:36.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded") failed: Property not found. retry in 891.888004ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded
15722024-11-19T19:40:36.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3") failed: Property not found. retry in 1.166578077s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
15732024-11-19T19:40:36.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922") failed: Property not found. retry in 726.670121ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
15742024-11-19T19:40:36.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec") failed: Property not found. retry in 506.619296ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec
15752024-11-19T19:40:36.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94") failed: Property not found. retry in 1.392451406s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94
15762024-11-19T19:40:36.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd") failed: Property not found. retry in 785.692919ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
15772024-11-19T19:40:36.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca") failed: Property not found. retry in 875.249554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
15782024-11-19T19:40:36.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4") failed: Property not found. retry in 966.565494ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4
15792024-11-19T19:40:36.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2") failed: Property not found. retry in 1.470108379s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
15802024-11-19T19:40:36.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3774459-cd71-4201-945b-422fa6090793") failed: Property not found. retry in 901.365741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
15812024-11-19T19:40:36.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec") failed: Property not found. retry in 1.472038158s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec
15822024-11-19T19:40:36.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e") failed: Property not found. retry in 1.20002015s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e
15832024-11-19T19:40:36.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded") failed: Property not found. retry in 1.004235942s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded
15842024-11-19T19:40:37.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922") failed: Property not found. retry in 1.271103615s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
15852024-11-19T19:40:37.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3") failed: Property not found. retry in 1.492887798s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
15862024-11-19T19:40:37.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd") failed: Property not found. retry in 1.424096731s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
15872024-11-19T19:40:37.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8") failed: Property not found. retry in 899.715762ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8
15882024-11-19T19:40:37.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94") failed: Property not found. retry in 1.061798688s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94
15892024-11-19T19:40:38.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded") failed: Property not found. retry in 981.963403ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded
15902024-11-19T19:40:38.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e") failed: Property not found. retry in 998.374015ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e
15912024-11-19T19:40:38.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8") failed: Property not found. retry in 1.18974378s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8
15922024-11-19T19:40:38.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922") failed: Property not found. retry in 582.492921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
15932024-11-19T19:40:38.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3") failed: Property not found. retry in 1.164641764s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
15942024-11-19T19:40:38.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd") failed: Property not found. retry in 1.299598219s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
15952024-11-19T19:40:39.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded") failed: Property not found. retry in 1.32258112s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded
15962024-11-19T19:40:39.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94") failed: Property not found. retry in 1.432421988s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94
15972024-11-19T19:40:39.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e") failed: Property not found. retry in 1.429033855s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e
15982024-11-19T19:40:39.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8") failed: Property not found. retry in 1.48576983s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8
15992024-11-19T19:40:39.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3") failed: Property not found. retry in 995.325258ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
16002024-11-19T19:40:40.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded") failed: Property not found. retry in 1.085481357s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded
16012024-11-19T19:40:40.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94") failed: Property not found. retry in 1.200573264s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94
16022024-11-19T19:40:41.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded") failed: Property not found. retry in 763.846311ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded
16032024-11-19T19:40:42.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded") failed: Property not found. retry in 519.710212ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded
16042024-11-19T19:40:42.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded") failed: Property not found. retry in 834.3158ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded
16052024-11-19T19:40:43.621ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_616e36c0-dd43-4cc2-ab3b-07823e2bc4d8
16062024-11-19T19:40:43.621ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_clickhouse_d1a786d5-a3bc-47ae-839c-41e5c669cded
16072024-11-19T19:40:43.621ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_external_dns_6805754c-e76e-4239-8505-cec4433c6625
16082024-11-19T19:40:43.621ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_oximeter_de978b94-a70f-4779-892c-8ea3260e7a5e
16092024-11-19T19:40:43.621ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_d9d1ae13-4716-4771-90e6-8ecdc4c05c85
16102024-11-19T19:40:43.621ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_fcb2f612-28f0-47ef-897a-def7e58073c4
16112024-11-19T19:40:43.621ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_3b899e78-5a22-4524-bdc5-5b48be76c922
16122024-11-19T19:40:43.622ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_e3774459-cd71-4201-945b-422fa6090793
16132024-11-19T19:40:43.622ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_ef00869b-140c-486a-8a8a-8b64b6f3d7fe
16142024-11-19T19:40:43.622ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_49f295e3-ca2a-47d4-89d2-4149b9f103ca
16152024-11-19T19:40:43.622ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_external_dns_b66ee542-3bb8-4a73-84f4-750c58e065cd
16162024-11-19T19:40:43.622ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_32b0278d-b5e0-48f7-97b1-7e59a0a057ad
16172024-11-19T19:40:43.622ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_d2869dcb-02ac-4b14-a79c-5e73e9f82137
16182024-11-19T19:40:43.622ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_cef07d83-499b-4be2-b722-26ee3dd3e6b9
16192024-11-19T19:40:43.622ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_40599e7f-8b43-4bdb-b180-416ff8515df2
16202024-11-19T19:40:43.622ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_a238092b-0954-4096-883d-bda0dc7df516
16212024-11-19T19:40:43.622ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_2dc55787-6af7-4852-9d52-5bcecccf75ec
16222024-11-19T19:40:43.622ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_55c1d4bf-7793-4af3-b4d3-e162197a6fc3
16232024-11-19T19:40:43.622ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_6880cb29-d555-4d40-84be-52baa0347d94
16242024-11-19T19:40:43.623ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
16252024-11-19T19:40:43.630ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json"
16262024-11-19T19:40:43.630ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
16272024-11-19T19:40:43.632ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json"
16282024-11-19T19:40:43.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24952787 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:63852 req_id = 84992155-e455-40de-9a19-f710841aee37 response_code = 204 uri = /omicron-zones
16292024-11-19T19:40:43.644ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1448
16302024-11-19T19:40:43.644ZINFOSledAgent (RSS): Writing ledger to /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:200
16312024-11-19T19:40:43.644ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/rss-plan-completed.marker"
16322024-11-19T19:40:43.644ZINFOSledAgent (RSS): Writing ledger to /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:200
16332024-11-19T19:40:43.644ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/rss-plan-completed.marker"
16342024-11-19T19:40:43.652ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
16352024-11-19T19:40:43.653ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:799
16362024-11-19T19:40:43.692ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1013
16372024-11-19T19:40:43.701ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/479337c4-04f4-4e7a-9efb-a08d086d843e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16382024-11-19T19:40:43.846ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/479337c4-04f4-4e7a-9efb-a08d086d843e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16392024-11-19T19:40:43.960ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/479337c4-04f4-4e7a-9efb-a08d086d843e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16402024-11-19T19:40:44.129ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/479337c4-04f4-4e7a-9efb-a08d086d843e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16412024-11-19T19:40:44.240ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/479337c4-04f4-4e7a-9efb-a08d086d843e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16422024-11-19T19:40:44.381ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/479337c4-04f4-4e7a-9efb-a08d086d843e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16432024-11-19T19:40:44.702ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/probe_manager.rs:231 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
16442024-11-19T19:40:44.702ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/nexus.rs:527 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
16452024-11-19T19:40:44.745ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/479337c4-04f4-4e7a-9efb-a08d086d843e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16462024-11-19T19:40:45.161ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/479337c4-04f4-4e7a-9efb-a08d086d843e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16472024-11-19T19:40:45.403ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/479337c4-04f4-4e7a-9efb-a08d086d843e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16482024-11-19T19:40:45.650ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/479337c4-04f4-4e7a-9efb-a08d086d843e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16492024-11-19T19:40:45.719ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/probe_manager.rs:231 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
16502024-11-19T19:40:46.045ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64529
16512024-11-19T19:40:46.047ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64529 req_id = cd920836-3430-472d-8d67-e558bc6411d0 response_code = 200 uri = /baseboard
16522024-11-19T19:40:46.209ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/479337c4-04f4-4e7a-9efb-a08d086d843e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16532024-11-19T19:40:46.582ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/nexus.rs:527 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
16542024-11-19T19:40:46.722ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/probe_manager.rs:231 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
16552024-11-19T19:40:46.955ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/479337c4-04f4-4e7a-9efb-a08d086d843e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16562024-11-19T19:40:47.505ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/479337c4-04f4-4e7a-9efb-a08d086d843e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16572024-11-19T19:40:47.725ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/367f799f-31b8-4d9a-a686-ab6e465d52be) file = sled-agent/src/probe_manager.rs:231 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
16582024-11-19T19:40:48.322ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/479337c4-04f4-4e7a-9efb-a08d086d843e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16592024-11-19T19:40:50.971ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
16602024-11-19T19:40:52.718ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f0aeeb9a-1873-4579-830e-eeda4ef656e1", "content-length": "173", "date": "Tue, 19 Nov 2024 19:40:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"479337c4-04f4-4e7a-9efb-a08d086d843e\"", request_id: "f0aeeb9a-1873-4579-830e-eeda4ef656e1" } file = sled-agent/src/rack_setup/service.rs:1075
16612024-11-19T19:40:54.347ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "38c72d08-bce7-414b-9b67-a204e64358b5", "content-length": "173", "date": "Tue, 19 Nov 2024 19:40:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"479337c4-04f4-4e7a-9efb-a08d086d843e\"", request_id: "38c72d08-bce7-414b-9b67-a204e64358b5" } file = sled-agent/src/rack_setup/service.rs:1075
16622024-11-19T19:40:56.493ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b0b95c37-877e-406a-93e2-202559042394", "content-length": "173", "date": "Tue, 19 Nov 2024 19:40:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"479337c4-04f4-4e7a-9efb-a08d086d843e\"", request_id: "b0b95c37-877e-406a-93e2-202559042394" } file = sled-agent/src/rack_setup/service.rs:1075
16632024-11-19T19:40:57.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59250
16642024-11-19T19:40:57.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 521 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59250 req_id = 4e24b9f7-e227-4c48-a044-63604c695df4 response_code = 200 uri = /vpc-routes
16652024-11-19T19:40:57.229ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
16662024-11-19T19:40:57.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 916 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59250 req_id = a39bb63b-6d26-4877-874d-aa9294b1fe1d response_code = 204 uri = /eip-gateways
16672024-11-19T19:40:57.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38299
16682024-11-19T19:40:57.271ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16692024-11-19T19:40:57.271ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
16702024-11-19T19:40:57.271ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json file = common/src/ledger.rs:178
16712024-11-19T19:40:57.273ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json file = common/src/ledger.rs:178
16722024-11-19T19:40:57.287ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16732024-11-19T19:40:57.287ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_a60d50c5-1d31-4171-ba2e-661c260a4561
16742024-11-19T19:40:57.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57484
16752024-11-19T19:40:57.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57484 req_id = 7c2318b3-9d42-4b87-9c2f-49a150c8ac41 response_code = 200 uri = /v2p
16762024-11-19T19:40:57.317ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16772024-11-19T19:40:57.317ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_be436df4-34a1-4101-90ff-be2f8ef7e824
16782024-11-19T19:40:57.344ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16792024-11-19T19:40:57.344ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_af234a87-284a-4af4-aac4-6b58ea279f05
16802024-11-19T19:40:57.371ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16812024-11-19T19:40:57.371ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_43c663f2-b051-403e-bcad-e419348a9017
16822024-11-19T19:40:57.398ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16832024-11-19T19:40:57.398ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c
16842024-11-19T19:40:57.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4571 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59250 req_id = 0a8f876b-a8bd-4c08-b15e-3ad66aff4ea4 response_code = 204 uri = /vpc-routes
16852024-11-19T19:40:57.425ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16862024-11-19T19:40:57.425ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b5075ce0-4de0-43fe-a8e8-40bff047022b
16872024-11-19T19:40:57.448ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16882024-11-19T19:40:57.448ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fa881b81-fb55-465b-a7d1-159614622ca4
16892024-11-19T19:40:57.470ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16902024-11-19T19:40:57.470ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_5d346fc3-b1ff-469c-a353-925addba06e4
16912024-11-19T19:40:57.492ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16922024-11-19T19:40:57.492ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3cdbf8c9-3584-411d-8acb-3e587708315a
16932024-11-19T19:40:57.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38299 req_id = 3acaa2f9-919e-4eae-b3c6-8b549d5f8b00 response_code = 200 uri = /inventory
16942024-11-19T19:40:58.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62327
16952024-11-19T19:40:58.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62327 req_id = 3eba285d-d63d-425f-ae6b-bc403d52b196 response_code = 200 uri = /vpc-routes
16962024-11-19T19:40:58.193ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
16972024-11-19T19:40:58.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62327 req_id = 9ae9e872-9497-40f7-8c19-61672846468e response_code = 204 uri = /eip-gateways
16982024-11-19T19:40:58.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40555
16992024-11-19T19:40:58.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40555 req_id = 768f5179-3be9-4b1e-acbb-cad358f32c04 response_code = 200 uri = /vpc-routes
17002024-11-19T19:40:58.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53362
17012024-11-19T19:40:58.309ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17022024-11-19T19:40:58.309ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17032024-11-19T19:40:58.309ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json file = common/src/ledger.rs:178
17042024-11-19T19:40:58.309ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json file = common/src/ledger.rs:178
17052024-11-19T19:40:58.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50626
17062024-11-19T19:40:58.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50626 req_id = f68f25b1-a497-4925-b8dd-dac3c64d685f response_code = 200 uri = /v2p
17072024-11-19T19:40:58.321ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17082024-11-19T19:40:58.321ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_a60d50c5-1d31-4171-ba2e-661c260a4561
17092024-11-19T19:40:58.340ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
17102024-11-19T19:40:58.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40555 req_id = a096d931-650a-4ae1-b2ef-f6cd2250e9a8 response_code = 204 uri = /eip-gateways
17112024-11-19T19:40:58.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53376
17122024-11-19T19:40:58.351ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17132024-11-19T19:40:58.351ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17142024-11-19T19:40:58.351ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json file = common/src/ledger.rs:178
17152024-11-19T19:40:58.351ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json file = common/src/ledger.rs:178
17162024-11-19T19:40:58.355ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17172024-11-19T19:40:58.355ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_be436df4-34a1-4101-90ff-be2f8ef7e824
17182024-11-19T19:40:58.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56760
17192024-11-19T19:40:58.374ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17202024-11-19T19:40:58.374ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_a60d50c5-1d31-4171-ba2e-661c260a4561
17212024-11-19T19:40:58.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35455
17222024-11-19T19:40:58.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35455 req_id = 7243857e-ba85-4071-a333-f84d7779e9b8 response_code = 200 uri = /v2p
17232024-11-19T19:40:58.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17242024-11-19T19:40:58.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17252024-11-19T19:40:58.397ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17262024-11-19T19:40:58.397ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_af234a87-284a-4af4-aac4-6b58ea279f05
17272024-11-19T19:40:58.397ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json file = common/src/ledger.rs:178
17282024-11-19T19:40:58.406ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json file = common/src/ledger.rs:178
17292024-11-19T19:40:58.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6602 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62327 req_id = d9038b96-7330-4699-b40a-400e5061829c response_code = 204 uri = /vpc-routes
17302024-11-19T19:40:58.415ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17312024-11-19T19:40:58.415ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_be436df4-34a1-4101-90ff-be2f8ef7e824
17322024-11-19T19:40:58.433ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17332024-11-19T19:40:58.433ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_a60d50c5-1d31-4171-ba2e-661c260a4561
17342024-11-19T19:40:58.451ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17352024-11-19T19:40:58.451ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_43c663f2-b051-403e-bcad-e419348a9017
17362024-11-19T19:40:58.470ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17372024-11-19T19:40:58.470ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_af234a87-284a-4af4-aac4-6b58ea279f05
17382024-11-19T19:40:58.479ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } subnet = RouterId { vni: Vni(100), kind: System }
17392024-11-19T19:40:58.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40555 req_id = 80bc2456-9dde-48a7-9495-6e2b77b280de response_code = 204 uri = /vpc-routes
17402024-11-19T19:40:58.487ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17412024-11-19T19:40:58.487ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_be436df4-34a1-4101-90ff-be2f8ef7e824
17422024-11-19T19:40:58.504ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17432024-11-19T19:40:58.505ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c
17442024-11-19T19:40:58.521ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17452024-11-19T19:40:58.521ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_43c663f2-b051-403e-bcad-e419348a9017
17462024-11-19T19:40:58.542ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17472024-11-19T19:40:58.542ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_af234a87-284a-4af4-aac4-6b58ea279f05
17482024-11-19T19:40:58.558ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17492024-11-19T19:40:58.558ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b5075ce0-4de0-43fe-a8e8-40bff047022b
17502024-11-19T19:40:58.572ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17512024-11-19T19:40:58.572ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c
17522024-11-19T19:40:58.588ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17532024-11-19T19:40:58.588ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_43c663f2-b051-403e-bcad-e419348a9017
17542024-11-19T19:40:58.606ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17552024-11-19T19:40:58.606ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fa881b81-fb55-465b-a7d1-159614622ca4
17562024-11-19T19:40:58.621ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17572024-11-19T19:40:58.621ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b5075ce0-4de0-43fe-a8e8-40bff047022b
17582024-11-19T19:40:58.636ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17592024-11-19T19:40:58.636ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c
17602024-11-19T19:40:58.652ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17612024-11-19T19:40:58.652ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_5d346fc3-b1ff-469c-a353-925addba06e4
17622024-11-19T19:40:58.668ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17632024-11-19T19:40:58.668ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fa881b81-fb55-465b-a7d1-159614622ca4
17642024-11-19T19:40:58.683ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17652024-11-19T19:40:58.683ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b5075ce0-4de0-43fe-a8e8-40bff047022b
17662024-11-19T19:40:58.697ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17672024-11-19T19:40:58.697ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3cdbf8c9-3584-411d-8acb-3e587708315a
17682024-11-19T19:40:58.711ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17692024-11-19T19:40:58.712ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_5d346fc3-b1ff-469c-a353-925addba06e4
17702024-11-19T19:40:58.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 406140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53362 req_id = 6ef9f0aa-2447-4647-ae1d-66a9b9db7e74 response_code = 200 uri = /inventory
17712024-11-19T19:40:58.725ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17722024-11-19T19:40:58.725ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fa881b81-fb55-465b-a7d1-159614622ca4
17732024-11-19T19:40:58.744ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17742024-11-19T19:40:58.744ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3cdbf8c9-3584-411d-8acb-3e587708315a
17752024-11-19T19:40:58.760ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17762024-11-19T19:40:58.760ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_5d346fc3-b1ff-469c-a353-925addba06e4
17772024-11-19T19:40:58.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 427007 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53376 req_id = 0cf03403-ba94-47b0-9925-72e866c0cd29 response_code = 200 uri = /inventory
17782024-11-19T19:40:58.784ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17792024-11-19T19:40:58.784ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3cdbf8c9-3584-411d-8acb-3e587708315a
17802024-11-19T19:40:58.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 425223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56760 req_id = 2f58064c-5762-4412-9c89-a0c227c332bb response_code = 200 uri = /inventory
17812024-11-19T19:41:01.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51129
17822024-11-19T19:41:01.399ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5b8bfa18-7354-4f55-a504-480af517e18d, kind: Service { id: b66ee542-3bb8-4a73-84f4-750c58e065cd }, name: Name("external-dns-b66ee542-3bb8-4a73-84f4-750c58e065cd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 138])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7dd645f-0047-411a-97d8-aca563c9c84b, kind: Service { id: 6805754c-e76e-4239-8505-cec4433c6625 }, name: Name("external-dns-6805754c-e76e-4239-8505-cec4433c6625"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3b3cb3e0-07fc-4857-ac35-656c692da813, kind: Service { id: 6880cb29-d555-4d40-84be-52baa0347d94 }, name: Name("nexus-6880cb29-d555-4d40-84be-52baa0347d94"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a9d89c40-50f5-46df-aa3f-9729aafbd4c1, kind: Service { id: 616e36c0-dd43-4cc2-ab3b-07823e2bc4d8 }, name: Name("nexus-616e36c0-dd43-4cc2-ab3b-07823e2bc4d8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3d55a5-b61f-48a6-b94d-766c7b25e0c2, kind: Service { id: 55c1d4bf-7793-4af3-b4d3-e162197a6fc3 }, name: Name("nexus-55c1d4bf-7793-4af3-b4d3-e162197a6fc3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17832024-11-19T19:41:01.399ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17842024-11-19T19:41:01.400ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17852024-11-19T19:41:01.400ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17862024-11-19T19:41:01.400ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17872024-11-19T19:41:01.400ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17882024-11-19T19:41:01.400ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17892024-11-19T19:41:01.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2997 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51129 req_id = 68db8fdd-809e-4aea-9e67-8ebf69596f57 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17902024-11-19T19:41:01.402ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1085
17912024-11-19T19:41:01.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36044
17922024-11-19T19:41:01.734ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5b8bfa18-7354-4f55-a504-480af517e18d, kind: Service { id: b66ee542-3bb8-4a73-84f4-750c58e065cd }, name: Name("external-dns-b66ee542-3bb8-4a73-84f4-750c58e065cd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 138])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7dd645f-0047-411a-97d8-aca563c9c84b, kind: Service { id: 6805754c-e76e-4239-8505-cec4433c6625 }, name: Name("external-dns-6805754c-e76e-4239-8505-cec4433c6625"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3b3cb3e0-07fc-4857-ac35-656c692da813, kind: Service { id: 6880cb29-d555-4d40-84be-52baa0347d94 }, name: Name("nexus-6880cb29-d555-4d40-84be-52baa0347d94"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a9d89c40-50f5-46df-aa3f-9729aafbd4c1, kind: Service { id: 616e36c0-dd43-4cc2-ab3b-07823e2bc4d8 }, name: Name("nexus-616e36c0-dd43-4cc2-ab3b-07823e2bc4d8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3d55a5-b61f-48a6-b94d-766c7b25e0c2, kind: Service { id: 55c1d4bf-7793-4af3-b4d3-e162197a6fc3 }, name: Name("nexus-55c1d4bf-7793-4af3-b4d3-e162197a6fc3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17932024-11-19T19:41:01.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17942024-11-19T19:41:01.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17952024-11-19T19:41:01.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17962024-11-19T19:41:01.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17972024-11-19T19:41:01.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17982024-11-19T19:41:01.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17992024-11-19T19:41:01.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36044 req_id = 26cebe9d-3d6e-4d8a-89e4-7c3a7c852576 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18002024-11-19T19:41:01.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50268
18012024-11-19T19:41:01.735ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18022024-11-19T19:41:01.735ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18032024-11-19T19:41:01.735ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json file = common/src/ledger.rs:178
18042024-11-19T19:41:01.735ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json file = common/src/ledger.rs:178
18052024-11-19T19:41:01.748ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18062024-11-19T19:41:01.748ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_a60d50c5-1d31-4171-ba2e-661c260a4561
18072024-11-19T19:41:01.774ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18082024-11-19T19:41:01.774ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_be436df4-34a1-4101-90ff-be2f8ef7e824
18092024-11-19T19:41:01.798ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18102024-11-19T19:41:01.798ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_af234a87-284a-4af4-aac4-6b58ea279f05
18112024-11-19T19:41:01.822ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18122024-11-19T19:41:01.823ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_43c663f2-b051-403e-bcad-e419348a9017
18132024-11-19T19:41:01.848ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18142024-11-19T19:41:01.848ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c
18152024-11-19T19:41:01.871ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18162024-11-19T19:41:01.871ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b5075ce0-4de0-43fe-a8e8-40bff047022b
18172024-11-19T19:41:01.892ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18182024-11-19T19:41:01.892ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fa881b81-fb55-465b-a7d1-159614622ca4
18192024-11-19T19:41:01.913ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18202024-11-19T19:41:01.913ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_5d346fc3-b1ff-469c-a353-925addba06e4
18212024-11-19T19:41:01.935ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18222024-11-19T19:41:01.935ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3cdbf8c9-3584-411d-8acb-3e587708315a
18232024-11-19T19:41:01.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50268 req_id = f609054e-6e0a-465d-b8a6-09248203cd35 response_code = 200 uri = /inventory
18242024-11-19T19:41:03.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60772
18252024-11-19T19:41:03.065ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5b8bfa18-7354-4f55-a504-480af517e18d, kind: Service { id: b66ee542-3bb8-4a73-84f4-750c58e065cd }, name: Name("external-dns-b66ee542-3bb8-4a73-84f4-750c58e065cd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 138])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7dd645f-0047-411a-97d8-aca563c9c84b, kind: Service { id: 6805754c-e76e-4239-8505-cec4433c6625 }, name: Name("external-dns-6805754c-e76e-4239-8505-cec4433c6625"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3b3cb3e0-07fc-4857-ac35-656c692da813, kind: Service { id: 6880cb29-d555-4d40-84be-52baa0347d94 }, name: Name("nexus-6880cb29-d555-4d40-84be-52baa0347d94"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a9d89c40-50f5-46df-aa3f-9729aafbd4c1, kind: Service { id: 616e36c0-dd43-4cc2-ab3b-07823e2bc4d8 }, name: Name("nexus-616e36c0-dd43-4cc2-ab3b-07823e2bc4d8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3d55a5-b61f-48a6-b94d-766c7b25e0c2, kind: Service { id: 55c1d4bf-7793-4af3-b4d3-e162197a6fc3 }, name: Name("nexus-55c1d4bf-7793-4af3-b4d3-e162197a6fc3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18262024-11-19T19:41:03.065ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18272024-11-19T19:41:03.065ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18282024-11-19T19:41:03.065ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18292024-11-19T19:41:03.065ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18302024-11-19T19:41:03.065ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18312024-11-19T19:41:03.065ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18322024-11-19T19:41:03.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60772 req_id = 39c2fe20-7cb3-4bf4-9729-0998080c9833 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18332024-11-19T19:41:03.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40500
18342024-11-19T19:41:03.186ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5b8bfa18-7354-4f55-a504-480af517e18d, kind: Service { id: b66ee542-3bb8-4a73-84f4-750c58e065cd }, name: Name("external-dns-b66ee542-3bb8-4a73-84f4-750c58e065cd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 138])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7dd645f-0047-411a-97d8-aca563c9c84b, kind: Service { id: 6805754c-e76e-4239-8505-cec4433c6625 }, name: Name("external-dns-6805754c-e76e-4239-8505-cec4433c6625"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3b3cb3e0-07fc-4857-ac35-656c692da813, kind: Service { id: 6880cb29-d555-4d40-84be-52baa0347d94 }, name: Name("nexus-6880cb29-d555-4d40-84be-52baa0347d94"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a9d89c40-50f5-46df-aa3f-9729aafbd4c1, kind: Service { id: 616e36c0-dd43-4cc2-ab3b-07823e2bc4d8 }, name: Name("nexus-616e36c0-dd43-4cc2-ab3b-07823e2bc4d8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3d55a5-b61f-48a6-b94d-766c7b25e0c2, kind: Service { id: 55c1d4bf-7793-4af3-b4d3-e162197a6fc3 }, name: Name("nexus-55c1d4bf-7793-4af3-b4d3-e162197a6fc3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18352024-11-19T19:41:03.186ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18362024-11-19T19:41:03.187ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18372024-11-19T19:41:03.187ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18382024-11-19T19:41:03.187ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18392024-11-19T19:41:03.187ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18402024-11-19T19:41:03.187ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18412024-11-19T19:41:03.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40500 req_id = 7d9726df-ece3-44d6-ac58-d0c7fb0c7824 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18422024-11-19T19:41:08.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52263
18432024-11-19T19:41:08.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52263 req_id = a9289a4a-c8c8-44b3-83c5-d1294569328a response_code = 200 uri = /vpc-routes
18442024-11-19T19:41:08.590ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
18452024-11-19T19:41:08.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52263 req_id = 85eb5963-8a1b-403a-9945-5decb99ca171 response_code = 204 uri = /eip-gateways
18462024-11-19T19:41:08.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 747 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52263 req_id = 989d581a-368b-4a65-b01d-aadcc551288c response_code = 204 uri = /vpc-routes
18472024-11-19T19:41:16.084ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51731
18482024-11-19T19:41:16.084ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51731 req_id = 36863763-9142-4360-a61e-bb3d2c072afe response_code = 200 uri = /baseboard
18492024-11-19T19:41:26.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61735
18502024-11-19T19:41:26.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61735 req_id = a3626ef0-c16c-4c6c-bedb-0644f0969f39 response_code = 200 uri = /vpc-routes
18512024-11-19T19:41:26.932ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
18522024-11-19T19:41:26.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61735 req_id = 66c51424-389e-4fa4-a40e-71955af208e0 response_code = 204 uri = /eip-gateways
18532024-11-19T19:41:26.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61735 req_id = f0fbbb18-611e-4bd7-ac77-58911f96941c response_code = 204 uri = /vpc-routes
18542024-11-19T19:41:27.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49678
18552024-11-19T19:41:27.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49678 req_id = 1afa663f-e3c1-4972-aedc-b3684948a14a response_code = 200 uri = /v2p
18562024-11-19T19:41:27.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39676
18572024-11-19T19:41:27.044ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18582024-11-19T19:41:27.110ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18592024-11-19T19:41:27.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132392 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39676 req_id = 0919cc9a-bf5d-4d9f-b73a-e27413d6a122 response_code = 204 uri = /switch-ports
18602024-11-19T19:41:27.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39676 req_id = 74cb25e9-cb60-4630-ba99-91f9a2cc8ba7 response_code = 200 uri = /network-bootstore-config
18612024-11-19T19:41:27.347ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
18622024-11-19T19:41:27.348ZINFOSledAgent (bootstore): Writing ledger to /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
18632024-11-19T19:41:27.350ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
18642024-11-19T19:41:27.350ZINFOSledAgent (bootstore): Writing ledger to /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
18652024-11-19T19:41:27.351ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
18662024-11-19T19:41:27.351ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
18672024-11-19T19:41:27.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39676 req_id = bef0106d-c278-4739-b5d2-dd1123319739 response_code = 204 uri = /network-bootstore-config
18682024-11-19T19:41:27.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42619
18692024-11-19T19:41:27.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42619 req_id = 87f42080-db0c-41cb-854e-516df5f1c2b2 response_code = 200 uri = /vpc-routes
18702024-11-19T19:41:28.053ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
18712024-11-19T19:41:28.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42619 req_id = 6d45238a-2f67-49ee-93bd-6869bac38a86 response_code = 204 uri = /eip-gateways
18722024-11-19T19:41:28.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42619 req_id = a7ccf743-0f6a-4be0-88f6-4e3f889e5657 response_code = 204 uri = /vpc-routes
18732024-11-19T19:41:28.112ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50066
18742024-11-19T19:41:28.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50066 req_id = c8904be7-662a-47b8-8602-f6f9795f0e5a response_code = 200 uri = /vpc-routes
18752024-11-19T19:41:28.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34682
18762024-11-19T19:41:28.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34682 req_id = 44cf3920-c6b6-4445-906c-363b3ab50b85 response_code = 200 uri = /v2p
18772024-11-19T19:41:28.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33022
18782024-11-19T19:41:28.164ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18792024-11-19T19:41:28.204ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18802024-11-19T19:41:28.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95065 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33022 req_id = 332c5add-7d2f-451c-9f63-ee0f8b904fe7 response_code = 204 uri = /switch-ports
18812024-11-19T19:41:28.259ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
18822024-11-19T19:41:28.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50066 req_id = 2a8ae812-8926-40e4-a971-b82454eaba6d response_code = 204 uri = /eip-gateways
18832024-11-19T19:41:28.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 598 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33022 req_id = 2e151b4d-1467-4a13-b5ad-a9ae093595a4 response_code = 200 uri = /network-bootstore-config
18842024-11-19T19:41:28.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50066 req_id = fe9537f8-e5d4-4813-add3-e9835d1162e2 response_code = 204 uri = /vpc-routes
18852024-11-19T19:41:28.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38939
18862024-11-19T19:41:28.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38939 req_id = 59fbc2ac-86fb-46aa-852f-5680789d83cb response_code = 200 uri = /v2p
18872024-11-19T19:41:28.455ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60275
18882024-11-19T19:41:28.455ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18892024-11-19T19:41:28.491ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18902024-11-19T19:41:28.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93078 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60275 req_id = b113a71c-5050-4144-a330-1abe836b25d0 response_code = 204 uri = /switch-ports
18912024-11-19T19:41:28.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60275 req_id = 7ab4f36b-6898-4098-981a-6f50d22e734f response_code = 200 uri = /network-bootstore-config
18922024-11-19T19:41:46.146ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33834
18932024-11-19T19:41:46.146ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33834 req_id = 6bbb2448-0e25-401d-9ef1-78f0fbb903a7 response_code = 200 uri = /baseboard
18942024-11-19T19:41:50.338ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:51326 remote_addr = [fd00:1122:3344:101::d]:35419 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
18952024-11-19T19:41:50.358ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19960 local_addr = [fd00:1122:3344:101::1]:51326 method = GET remote_addr = [fd00:1122:3344:101::d]:35419 req_id = a24728e2-1bb8-49e1-8076-637015f91a5f response_code = 200 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be uri = /367f799f-31b8-4d9a-a686-ab6e465d52be
18962024-11-19T19:41:55.017ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18972024-11-19T19:41:56.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59106
18982024-11-19T19:41:56.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59106 req_id = f3b1fb77-5f3d-4fb5-98d4-d34785d1d53d response_code = 200 uri = /vpc-routes
18992024-11-19T19:41:57.030ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
19002024-11-19T19:41:57.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59106 req_id = cc732544-f440-4f93-a5b1-fcf9e10030a2 response_code = 204 uri = /eip-gateways
19012024-11-19T19:41:57.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59106 req_id = 09d8031f-e5fe-42fc-b351-857486d754b2 response_code = 204 uri = /vpc-routes
19022024-11-19T19:41:57.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40996
19032024-11-19T19:41:57.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40996 req_id = 33cef8bf-0b91-46ec-89de-043e1e9479d9 response_code = 200 uri = /v2p
19042024-11-19T19:41:57.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58165
19052024-11-19T19:41:57.396ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19062024-11-19T19:41:57.431ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19072024-11-19T19:41:57.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87593 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58165 req_id = 764b425b-17d4-491e-b32d-aee778469a1f response_code = 204 uri = /switch-ports
19082024-11-19T19:41:57.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58165 req_id = e9e5e491-1417-49dd-b5e0-69f870066f72 response_code = 200 uri = /network-bootstore-config
19092024-11-19T19:41:58.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32781
19102024-11-19T19:41:58.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32781 req_id = 6e9d8c23-c065-4347-bb9f-72b8bc13a2ba response_code = 200 uri = /vpc-routes
19112024-11-19T19:41:58.146ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65359
19122024-11-19T19:41:58.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65359 req_id = 21751bb6-f96b-4742-ad7c-fbc3bc5dc476 response_code = 200 uri = /vpc-routes
19132024-11-19T19:41:58.179ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
19142024-11-19T19:41:58.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65359 req_id = 7961d4d5-13c1-4e2e-beb4-bfb5e8100b07 response_code = 204 uri = /eip-gateways
19152024-11-19T19:41:58.196ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
19162024-11-19T19:41:58.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32781 req_id = 573f8478-2165-49f2-922c-3e0eb3e4076c response_code = 204 uri = /eip-gateways
19172024-11-19T19:41:58.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65359 req_id = 9cd87be2-0303-4186-aa9b-419a2c4dbba4 response_code = 204 uri = /vpc-routes
19182024-11-19T19:41:58.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32781 req_id = 5474625c-f747-4ec0-ad43-0e1bf5d6715a response_code = 204 uri = /vpc-routes
19192024-11-19T19:41:58.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52386
19202024-11-19T19:41:58.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52386 req_id = 368e8ef8-b68a-4657-b33c-469a50253038 response_code = 200 uri = /v2p
19212024-11-19T19:41:58.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46045
19222024-11-19T19:41:58.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46045 req_id = 2e746f59-5f9c-417a-91dd-e5cc6304af32 response_code = 200 uri = /v2p
19232024-11-19T19:41:58.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35030
19242024-11-19T19:41:58.524ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19252024-11-19T19:41:58.564ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19262024-11-19T19:41:58.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103086 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35030 req_id = e2960e44-628f-485f-b8e1-70e7db4e982f response_code = 204 uri = /switch-ports
19272024-11-19T19:41:58.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56201
19282024-11-19T19:41:58.627ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19292024-11-19T19:41:58.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3528 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35030 req_id = 5f78347b-6f1b-468f-a67a-04785c5731a4 response_code = 200 uri = /network-bootstore-config
19302024-11-19T19:41:58.667ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19312024-11-19T19:41:58.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99806 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56201 req_id = 7b8b4174-0ac6-4ee1-9b96-a003f2c99425 response_code = 204 uri = /switch-ports
19322024-11-19T19:41:58.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56201 req_id = 8b50bb1e-aec6-4248-a97e-86d039f183ec response_code = 200 uri = /network-bootstore-config
19332024-11-19T19:42:16.181ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57173
19342024-11-19T19:42:16.181ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57173 req_id = b0453809-489a-45ba-8df0-a5660ae9ff78 response_code = 200 uri = /baseboard
19352024-11-19T19:42:26.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57735
19362024-11-19T19:42:26.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57735 req_id = 00aef57a-cba1-41da-a5b1-c26aff76a2ba response_code = 200 uri = /vpc-routes
19372024-11-19T19:42:26.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55235
19382024-11-19T19:42:26.998ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19392024-11-19T19:42:27.034ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19402024-11-19T19:42:27.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89899 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55235 req_id = 266ac54b-ac92-445b-bab0-b8c094f5f6c5 response_code = 204 uri = /switch-ports
19412024-11-19T19:42:27.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45767
19422024-11-19T19:42:27.088ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
19432024-11-19T19:42:27.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57735 req_id = 21d1c8ac-ee68-48be-9c69-2100c64fd129 response_code = 204 uri = /eip-gateways
19442024-11-19T19:42:27.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55235 req_id = ffbab5e0-0bfa-4303-95a9-548769c61565 response_code = 200 uri = /network-bootstore-config
19452024-11-19T19:42:27.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45767 req_id = 43cfa347-d831-4f1b-af13-a6f5adb68ff1 response_code = 200 uri = /v2p
19462024-11-19T19:42:27.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57735 req_id = bda9faed-2f1d-4365-a7eb-501a8a191e01 response_code = 204 uri = /vpc-routes
19472024-11-19T19:42:27.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41457
19482024-11-19T19:42:27.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41457 req_id = 1c433310-800e-465c-85a7-7bb0b222d8f1 response_code = 200 uri = /vpc-routes
19492024-11-19T19:42:28.033ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
19502024-11-19T19:42:28.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41457 req_id = b25c68d2-d8f8-462c-8448-cfcdf7b66a81 response_code = 204 uri = /eip-gateways
19512024-11-19T19:42:28.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41457 req_id = dfe3d0a3-52fb-43a0-8ae4-d85c17d5bf24 response_code = 204 uri = /vpc-routes
19522024-11-19T19:42:28.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53125
19532024-11-19T19:42:28.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53125 req_id = ac98c615-9ff8-49e1-9327-322180d95e53 response_code = 200 uri = /v2p
19542024-11-19T19:42:28.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63133
19552024-11-19T19:42:28.129ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19562024-11-19T19:42:28.169ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19572024-11-19T19:42:28.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98192 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63133 req_id = c844693d-8862-4eb0-9383-b0f948b487c1 response_code = 204 uri = /switch-ports
19582024-11-19T19:42:28.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48049
19592024-11-19T19:42:28.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48049 req_id = af2d8e46-4f9a-4601-8306-aa631ed8a595 response_code = 200 uri = /vpc-routes
19602024-11-19T19:42:28.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63133 req_id = 2afa23c1-a7e9-4f84-a21b-8a8bddec17e8 response_code = 200 uri = /network-bootstore-config
19612024-11-19T19:42:28.245ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
19622024-11-19T19:42:28.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48049 req_id = 8fc750aa-c551-4231-995f-ac842bd21494 response_code = 204 uri = /eip-gateways
19632024-11-19T19:42:28.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 444 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48049 req_id = eaff78b6-6127-422c-b4f4-cdf4bc383074 response_code = 204 uri = /vpc-routes
19642024-11-19T19:42:28.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58631
19652024-11-19T19:42:28.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58631 req_id = 6716f4a0-8e9c-45d7-86cf-f5ab4548978a response_code = 200 uri = /v2p
19662024-11-19T19:42:28.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38672
19672024-11-19T19:42:28.356ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19682024-11-19T19:42:28.391ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19692024-11-19T19:42:28.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88605 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38672 req_id = 17d03d99-8cb1-442a-bcc3-919d2aaed15c response_code = 204 uri = /switch-ports
19702024-11-19T19:42:28.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38672 req_id = 50f2e3fe-5c4e-451c-a1ce-519754411eca response_code = 200 uri = /network-bootstore-config
19712024-11-19T19:42:46.213ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55740
19722024-11-19T19:42:46.213ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55740 req_id = 7dd2345a-9a6e-41e9-89db-753d1a6cce36 response_code = 200 uri = /baseboard
19732024-11-19T19:42:57.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56108
19742024-11-19T19:42:57.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56108 req_id = 054da075-215d-4e29-9857-69ed8e5a4a03 response_code = 200 uri = /vpc-routes
19752024-11-19T19:42:57.080ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
19762024-11-19T19:42:57.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56108 req_id = 429dc211-6924-4919-afd0-49255d211d18 response_code = 204 uri = /eip-gateways
19772024-11-19T19:42:57.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56108 req_id = d733f5f8-69a0-4f9f-bb1a-7a3f3b6d87db response_code = 204 uri = /vpc-routes
19782024-11-19T19:42:57.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33247
19792024-11-19T19:42:57.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33247 req_id = de562a95-bbd6-485b-928a-47ca627651e1 response_code = 200 uri = /v2p
19802024-11-19T19:42:57.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40538
19812024-11-19T19:42:57.181ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19822024-11-19T19:42:57.219ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19832024-11-19T19:42:57.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92735 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40538 req_id = 7a2064ae-7642-46d2-9340-18bfe53fec27 response_code = 204 uri = /switch-ports
19842024-11-19T19:42:57.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40538 req_id = 750c4a50-75db-4194-a0f8-e112897abe71 response_code = 200 uri = /network-bootstore-config
19852024-11-19T19:42:58.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41359
19862024-11-19T19:42:58.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41359 req_id = 95fc294b-f634-44c0-9b11-4219eebb9714 response_code = 200 uri = /vpc-routes
19872024-11-19T19:42:58.194ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
19882024-11-19T19:42:58.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41359 req_id = d023dfd3-92fe-4a22-9e33-764770608e33 response_code = 204 uri = /eip-gateways
19892024-11-19T19:42:58.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41359 req_id = e5ea65f9-cac2-46b9-8e00-89563d14af63 response_code = 204 uri = /vpc-routes
19902024-11-19T19:42:58.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60351
19912024-11-19T19:42:58.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60351 req_id = a2000ae4-05ee-4f31-95a8-c6b4c9f0ade6 response_code = 200 uri = /vpc-routes
19922024-11-19T19:42:58.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51614
19932024-11-19T19:42:58.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51614 req_id = da62b027-a76e-48c3-93bb-ad0a55cacf61 response_code = 200 uri = /v2p
19942024-11-19T19:42:58.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50208
19952024-11-19T19:42:58.369ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19962024-11-19T19:42:58.408ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19972024-11-19T19:42:58.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93957 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50208 req_id = 8c403382-9604-4602-8069-c7755bed82a6 response_code = 204 uri = /switch-ports
19982024-11-19T19:42:58.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54623
19992024-11-19T19:42:58.463ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
20002024-11-19T19:42:58.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50208 req_id = 5f8b92cf-8cee-4ab1-8115-418049535051 response_code = 200 uri = /network-bootstore-config
20012024-11-19T19:42:58.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60351 req_id = 04878f29-5dfa-41f5-ae0f-04bffc29d1c2 response_code = 204 uri = /eip-gateways
20022024-11-19T19:42:58.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54623 req_id = e97c1ed4-5259-4ec0-87c9-9b7f50d9b90f response_code = 200 uri = /v2p
20032024-11-19T19:42:58.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60351 req_id = f46159fb-bf25-4a1c-816c-f3c18d78de85 response_code = 204 uri = /vpc-routes
20042024-11-19T19:42:58.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38802
20052024-11-19T19:42:58.542ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20062024-11-19T19:42:58.575ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20072024-11-19T19:42:58.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84923 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38802 req_id = bb09699e-d8d2-4855-832c-a21e88473feb response_code = 204 uri = /switch-ports
20082024-11-19T19:42:58.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38802 req_id = db480351-d958-4f43-b8c4-484fba064125 response_code = 200 uri = /network-bootstore-config
20092024-11-19T19:43:16.247ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51988
20102024-11-19T19:43:16.247ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51988 req_id = b247b8b9-0bfb-49a0-b5f0-08953b9c4a26 response_code = 200 uri = /baseboard
20112024-11-19T19:43:26.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35340
20122024-11-19T19:43:26.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35340 req_id = eb35d8e6-623c-4372-8d93-c02bc49ea19a response_code = 200 uri = /vpc-routes
20132024-11-19T19:43:26.956ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
20142024-11-19T19:43:26.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35340 req_id = 979f7b8f-772b-4249-9012-23e781cce988 response_code = 204 uri = /eip-gateways
20152024-11-19T19:43:26.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58773
20162024-11-19T19:43:26.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58773 req_id = d50c3d1b-6bd4-42d9-a3aa-22f723495240 response_code = 200 uri = /v2p
20172024-11-19T19:43:26.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35340 req_id = f2852efc-a45e-43f0-adb2-c2d7e538fd30 response_code = 204 uri = /vpc-routes
20182024-11-19T19:43:27.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50032
20192024-11-19T19:43:27.008ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20202024-11-19T19:43:27.043ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20212024-11-19T19:43:27.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89237 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50032 req_id = 21ece951-6d91-4988-8ace-81bf73e0e902 response_code = 204 uri = /switch-ports
20222024-11-19T19:43:27.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50032 req_id = 77d11645-e873-4cb5-98c1-95344dd63597 response_code = 200 uri = /network-bootstore-config
20232024-11-19T19:43:28.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50651
20242024-11-19T19:43:28.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50651 req_id = 8cc6d996-5029-4d87-abca-9828b6a18fde response_code = 200 uri = /vpc-routes
20252024-11-19T19:43:28.048ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
20262024-11-19T19:43:28.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50651 req_id = 1f58ebe5-49dc-4ebd-b27d-e9f9789b4a80 response_code = 204 uri = /eip-gateways
20272024-11-19T19:43:28.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50651 req_id = 630090b5-d080-4f95-bf32-2790d32d265a response_code = 204 uri = /vpc-routes
20282024-11-19T19:43:28.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58924
20292024-11-19T19:43:28.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58924 req_id = bd3befcb-9b05-4c49-b9ba-751f0aec8e26 response_code = 200 uri = /v2p
20302024-11-19T19:43:28.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44822
20312024-11-19T19:43:28.156ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20322024-11-19T19:43:28.192ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20332024-11-19T19:43:28.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90550 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44822 req_id = 765ea51e-bf5c-47e5-b87a-d8b70cbca281 response_code = 204 uri = /switch-ports
20342024-11-19T19:43:28.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36041
20352024-11-19T19:43:28.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36041 req_id = 8f1e2fd1-806f-4666-906e-dd0c9919c185 response_code = 200 uri = /vpc-routes
20362024-11-19T19:43:28.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44822 req_id = 7c592081-5e29-4f3c-8744-165c384b8c63 response_code = 200 uri = /network-bootstore-config
20372024-11-19T19:43:28.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52034
20382024-11-19T19:43:28.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52034 req_id = c879a9d5-8327-4ef0-81ff-9551c7b155ba response_code = 200 uri = /v2p
20392024-11-19T19:43:28.294ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
20402024-11-19T19:43:28.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36041 req_id = bafd00df-6921-426d-9707-e172b6bd02c9 response_code = 204 uri = /eip-gateways
20412024-11-19T19:43:28.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62525
20422024-11-19T19:43:28.297ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20432024-11-19T19:43:28.335ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20442024-11-19T19:43:28.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96065 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62525 req_id = 77b68a1c-1841-4681-ad03-3618fd0cc575 response_code = 204 uri = /switch-ports
20452024-11-19T19:43:28.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62525 req_id = 9716a05d-d8e0-4d04-acff-a8a276b9261a response_code = 200 uri = /network-bootstore-config
20462024-11-19T19:43:28.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36041 req_id = b95239b2-60a0-4a5c-afb8-e1c91cc9c09f response_code = 204 uri = /vpc-routes
20472024-11-19T19:43:46.280ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38538
20482024-11-19T19:43:46.280ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38538 req_id = a3739443-6ba6-4613-b0c0-1bb4d4768d39 response_code = 200 uri = /baseboard
20492024-11-19T19:43:57.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51971
20502024-11-19T19:43:57.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51971 req_id = 892d73c5-6eb0-4e08-ad92-2b278e825eb0 response_code = 200 uri = /vpc-routes
20512024-11-19T19:43:57.028ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
20522024-11-19T19:43:57.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51971 req_id = 5e779ace-c460-4701-b7fb-25b02aead54c response_code = 204 uri = /eip-gateways
20532024-11-19T19:43:57.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54976
20542024-11-19T19:43:57.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54976 req_id = 2e8b6066-c511-4417-9bb4-119dd5569069 response_code = 200 uri = /v2p
20552024-11-19T19:43:57.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51971 req_id = d1510e03-6a27-4ab2-972a-c076d955a263 response_code = 204 uri = /vpc-routes
20562024-11-19T19:43:57.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43022
20572024-11-19T19:43:57.197ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20582024-11-19T19:43:57.234ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20592024-11-19T19:43:57.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94182 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43022 req_id = 7888993a-8923-419e-b6d5-d76f5121030a response_code = 204 uri = /switch-ports
20602024-11-19T19:43:57.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43022 req_id = 51cbc138-d075-4a2f-b020-b9528bb1534a response_code = 200 uri = /network-bootstore-config
20612024-11-19T19:43:58.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38378
20622024-11-19T19:43:58.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38378 req_id = 4818191f-3b3f-4df8-bd63-9550564b5d5b response_code = 200 uri = /vpc-routes
20632024-11-19T19:43:58.202ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
20642024-11-19T19:43:58.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38378 req_id = 0ecc9bb9-afc2-42fb-97b1-65e644b5c19a response_code = 204 uri = /eip-gateways
20652024-11-19T19:43:58.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38378 req_id = 7b703dbd-c17b-43e6-9751-25c739be1361 response_code = 204 uri = /vpc-routes
20662024-11-19T19:43:58.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56666
20672024-11-19T19:43:58.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56666 req_id = b791d146-102f-4660-abac-9605025c1d19 response_code = 200 uri = /v2p
20682024-11-19T19:43:58.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56383
20692024-11-19T19:43:58.289ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20702024-11-19T19:43:58.325ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20712024-11-19T19:43:58.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85316 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56383 req_id = 4ed5c26d-002f-4fed-8456-2302fc2343f1 response_code = 204 uri = /switch-ports
20722024-11-19T19:43:58.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56383 req_id = bf6dee25-c8c0-49f6-947a-f47fa1cc9ad9 response_code = 200 uri = /network-bootstore-config
20732024-11-19T19:43:58.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39490
20742024-11-19T19:43:58.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39490 req_id = 9c74452a-0e89-458f-996b-257381858552 response_code = 200 uri = /v2p
20752024-11-19T19:43:58.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59348
20762024-11-19T19:43:58.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59348 req_id = 3d3e64ee-5f3d-4c49-8c17-37ce3d1ddadc response_code = 200 uri = /vpc-routes
20772024-11-19T19:43:58.472ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
20782024-11-19T19:43:58.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59348 req_id = 81a61956-8568-42c9-882c-bf31124dd850 response_code = 204 uri = /eip-gateways
20792024-11-19T19:43:58.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59348 req_id = 0d35b603-900a-4f51-8708-964ff8ce4293 response_code = 204 uri = /vpc-routes
20802024-11-19T19:43:58.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53108
20812024-11-19T19:43:58.533ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20822024-11-19T19:43:58.570ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20832024-11-19T19:43:58.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91764 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53108 req_id = ae716b60-faa5-41f7-9026-7f94bf425fb2 response_code = 204 uri = /switch-ports
20842024-11-19T19:43:58.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53108 req_id = 008c37ba-d8b4-4c77-aa2f-276e9602fdff response_code = 200 uri = /network-bootstore-config
20852024-11-19T19:44:16.319ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44153
20862024-11-19T19:44:16.319ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44153 req_id = 3236d604-5d3b-4c5c-9ec6-ce1f625f3643 response_code = 200 uri = /baseboard
20872024-11-19T19:44:26.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52601
20882024-11-19T19:44:26.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52601 req_id = 8a06118e-b586-4ab9-9305-f74f57d9ad41 response_code = 200 uri = /vpc-routes
20892024-11-19T19:44:26.915ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
20902024-11-19T19:44:26.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52601 req_id = 1b0d7409-e33d-463c-b9ba-0a82fe326057 response_code = 204 uri = /eip-gateways
20912024-11-19T19:44:26.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52601 req_id = 5da6ce9e-2a9b-43d7-98ed-4e02f599594e response_code = 204 uri = /vpc-routes
20922024-11-19T19:44:27.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59069
20932024-11-19T19:44:27.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59069 req_id = a49512b1-79c7-42a4-9c5d-b5ea78b02dc9 response_code = 200 uri = /v2p
20942024-11-19T19:44:27.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56675
20952024-11-19T19:44:27.091ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20962024-11-19T19:44:27.131ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20972024-11-19T19:44:27.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98030 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56675 req_id = 3ea0ddd4-8216-4579-89c7-f66b2c651e5a response_code = 204 uri = /switch-ports
20982024-11-19T19:44:27.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56675 req_id = abf62afe-5b33-4743-85a6-3f0946d55775 response_code = 200 uri = /network-bootstore-config
20992024-11-19T19:44:27.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56182
21002024-11-19T19:44:27.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56182 req_id = 223f5b6a-6174-468e-83cb-5372f3600e39 response_code = 200 uri = /vpc-routes
21012024-11-19T19:44:27.935ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
21022024-11-19T19:44:27.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56182 req_id = 11978d6c-c05c-45da-bd45-c08c4cc59953 response_code = 204 uri = /eip-gateways
21032024-11-19T19:44:27.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56182 req_id = b4802534-441b-4407-bab2-45d57819f997 response_code = 204 uri = /vpc-routes
21042024-11-19T19:44:28.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46480
21052024-11-19T19:44:28.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46480 req_id = e87e2eeb-14c9-4445-997e-e05be27b97bb response_code = 200 uri = /v2p
21062024-11-19T19:44:28.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49606
21072024-11-19T19:44:28.116ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21082024-11-19T19:44:28.154ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21092024-11-19T19:44:28.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95482 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49606 req_id = 2765c70c-ce6c-45de-a43c-e516ba4e4975 response_code = 204 uri = /switch-ports
21102024-11-19T19:44:28.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36968
21112024-11-19T19:44:28.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49606 req_id = 9f5cc125-3545-4cbd-a6a6-43232eb0e867 response_code = 200 uri = /network-bootstore-config
21122024-11-19T19:44:28.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36968 req_id = 42a34eed-95a9-428d-8589-bac8be6a1126 response_code = 200 uri = /vpc-routes
21132024-11-19T19:44:28.227ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
21142024-11-19T19:44:28.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36968 req_id = afdc37ec-f7f8-4bc4-87e5-08b7327f8415 response_code = 204 uri = /eip-gateways
21152024-11-19T19:44:28.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36968 req_id = cb6b2267-30e4-438c-a157-3bbc513f5922 response_code = 204 uri = /vpc-routes
21162024-11-19T19:44:28.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39001
21172024-11-19T19:44:28.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39001 req_id = 368c5a79-1e48-41bf-95bb-8fbae31592aa response_code = 200 uri = /v2p
21182024-11-19T19:44:28.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54699
21192024-11-19T19:44:28.367ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21202024-11-19T19:44:28.404ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21212024-11-19T19:44:28.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86102 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54699 req_id = e0cec240-162a-423a-a2e7-9cb2d159cc50 response_code = 204 uri = /switch-ports
21222024-11-19T19:44:28.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54699 req_id = 7054da3a-15e3-4b26-acad-dbed2572c6a6 response_code = 200 uri = /network-bootstore-config
21232024-11-19T19:44:46.359ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60344
21242024-11-19T19:44:46.359ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60344 req_id = 5c7a0add-855a-41d6-a75f-e2eba25928c9 response_code = 200 uri = /baseboard
21252024-11-19T19:44:57.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56118
21262024-11-19T19:44:57.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56118 req_id = 3e973dd0-4b5d-4906-941c-adc64ec460e3 response_code = 200 uri = /vpc-routes
21272024-11-19T19:44:57.087ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
21282024-11-19T19:44:57.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56118 req_id = a9c8301a-000d-49db-99fd-d4e16f020ec0 response_code = 204 uri = /eip-gateways
21292024-11-19T19:44:57.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56118 req_id = b00b9ad3-310e-4d4a-8a11-8c73763b0b58 response_code = 204 uri = /vpc-routes
21302024-11-19T19:44:57.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46879
21312024-11-19T19:44:57.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46879 req_id = 5a7caf87-442f-49e9-8d3f-632654180a89 response_code = 200 uri = /v2p
21322024-11-19T19:44:57.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35885
21332024-11-19T19:44:57.272ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21342024-11-19T19:44:57.309ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21352024-11-19T19:44:57.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89152 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35885 req_id = 78dfb582-9fa7-4257-a3de-f2d43a65c779 response_code = 204 uri = /switch-ports
21362024-11-19T19:44:57.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35885 req_id = dd4f33cf-9bc2-4fd0-9ddf-d9e740d1f1b6 response_code = 200 uri = /network-bootstore-config
21372024-11-19T19:44:58.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38736
21382024-11-19T19:44:58.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38736 req_id = d2f53ce9-4932-4c34-8d33-e36e28b3afc7 response_code = 200 uri = /vpc-routes
21392024-11-19T19:44:58.175ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
21402024-11-19T19:44:58.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38736 req_id = 9a674811-6a20-4c7e-97de-f39e1fe0e0e0 response_code = 204 uri = /eip-gateways
21412024-11-19T19:44:58.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38736 req_id = 5d2e75fb-9136-413b-b20b-0ae17bd251af response_code = 204 uri = /vpc-routes
21422024-11-19T19:44:58.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39726
21432024-11-19T19:44:58.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39726 req_id = e81d794d-4e30-4509-ad89-f974781223a2 response_code = 200 uri = /v2p
21442024-11-19T19:44:58.283ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35464
21452024-11-19T19:44:58.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35464 req_id = 3a748909-d4ce-4a40-8ab2-f6f7911a95c4 response_code = 200 uri = /vpc-routes
21462024-11-19T19:44:58.330ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
21472024-11-19T19:44:58.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35464 req_id = 6175afa0-8a4c-4d50-8742-a258e56faebe response_code = 204 uri = /eip-gateways
21482024-11-19T19:44:58.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59544
21492024-11-19T19:44:58.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59544 req_id = dfa719c0-ae02-4228-9009-1e4e86d177ed response_code = 200 uri = /v2p
21502024-11-19T19:44:58.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35464 req_id = 8ab245f3-1e9f-4da6-a083-c0575ffc7566 response_code = 204 uri = /vpc-routes
21512024-11-19T19:44:58.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41099
21522024-11-19T19:44:58.555ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21532024-11-19T19:44:58.593ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21542024-11-19T19:44:58.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93217 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41099 req_id = b5dbcbd7-4a8b-428d-ac13-a6365c100134 response_code = 204 uri = /switch-ports
21552024-11-19T19:44:58.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43934
21562024-11-19T19:44:58.649ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21572024-11-19T19:44:58.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41099 req_id = 806ddab8-97a8-49ae-9e4c-d4b4570c2278 response_code = 200 uri = /network-bootstore-config
21582024-11-19T19:44:58.685ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21592024-11-19T19:44:58.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89021 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43934 req_id = e63fcf4c-68f7-4be2-b450-a7a8cde22a3d response_code = 204 uri = /switch-ports
21602024-11-19T19:44:58.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43934 req_id = 809cc585-e07b-4361-8cc2-5684238661f9 response_code = 200 uri = /network-bootstore-config
21612024-11-19T19:45:16.394ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51207
21622024-11-19T19:45:16.394ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51207 req_id = 3e92d47b-5d90-4e82-a9eb-76af459c24c5 response_code = 200 uri = /baseboard
21632024-11-19T19:45:26.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50873
21642024-11-19T19:45:26.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50873 req_id = 99915089-4c3f-4f1b-a519-eb1d27a13193 response_code = 200 uri = /vpc-routes
21652024-11-19T19:45:26.918ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
21662024-11-19T19:45:26.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50873 req_id = f168babd-79df-40fc-812c-a54e3ffba037 response_code = 204 uri = /eip-gateways
21672024-11-19T19:45:26.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50873 req_id = 20e963ab-d2a1-4242-a05e-a2d3119b19ee response_code = 204 uri = /vpc-routes
21682024-11-19T19:45:27.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42030
21692024-11-19T19:45:27.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42030 req_id = 9fa0e783-cd4b-4a28-a83e-b387cce29a01 response_code = 200 uri = /v2p
21702024-11-19T19:45:27.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34648
21712024-11-19T19:45:27.059ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21722024-11-19T19:45:27.098ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21732024-11-19T19:45:27.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95131 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34648 req_id = f01f22b3-d590-426e-bf1c-36ce60cfc6de response_code = 204 uri = /switch-ports
21742024-11-19T19:45:27.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34648 req_id = 2f67fa4f-ec32-4d7f-9a24-289541bbe1bf response_code = 200 uri = /network-bootstore-config
21752024-11-19T19:45:27.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58294
21762024-11-19T19:45:27.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58294 req_id = f190f602-8484-4781-a527-3b70f0ec60ea response_code = 200 uri = /vpc-routes
21772024-11-19T19:45:28.063ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
21782024-11-19T19:45:28.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58294 req_id = 5604a889-ad37-4768-9ff6-671ed0ec3ee3 response_code = 204 uri = /eip-gateways
21792024-11-19T19:45:28.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58294 req_id = 3eb9cc06-046b-43df-a4bf-a322c3ff860c response_code = 204 uri = /vpc-routes
21802024-11-19T19:45:28.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32912
21812024-11-19T19:45:28.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32912 req_id = 44a9457f-aad1-448a-8247-c3d161c557b5 response_code = 200 uri = /vpc-routes
21822024-11-19T19:45:28.191ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
21832024-11-19T19:45:28.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32912 req_id = 5a4538bb-b4b2-4a82-bd56-232c501a4916 response_code = 204 uri = /eip-gateways
21842024-11-19T19:45:28.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60364
21852024-11-19T19:45:28.193ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21862024-11-19T19:45:28.233ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21872024-11-19T19:45:28.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97049 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60364 req_id = c4880005-e93e-447a-97a1-f0d320449d7d response_code = 204 uri = /switch-ports
21882024-11-19T19:45:28.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62684
21892024-11-19T19:45:28.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44280
21902024-11-19T19:45:28.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33932
21912024-11-19T19:45:28.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60364 req_id = 3ac7cc5c-cbd1-42ee-86bf-8c7586abd5eb response_code = 200 uri = /network-bootstore-config
21922024-11-19T19:45:28.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 512 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32912 req_id = a928dbb5-ce08-43eb-a98e-6726c7733933 response_code = 204 uri = /vpc-routes
21932024-11-19T19:45:28.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62684 req_id = 0b6b4742-228b-4cd1-ae3c-8623afa4747d response_code = 200 uri = /v2p
21942024-11-19T19:45:28.291ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21952024-11-19T19:45:28.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44280 req_id = 5b0c0295-b11d-4514-83ea-0b8161254d49 response_code = 200 uri = /v2p
21962024-11-19T19:45:28.328ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21972024-11-19T19:45:28.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91018 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33932 req_id = debb1252-ca38-4748-bcce-afc7e12e5d1d response_code = 204 uri = /switch-ports
21982024-11-19T19:45:28.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33932 req_id = 03aab981-7574-40b6-b204-b15dcda8ef8c response_code = 200 uri = /network-bootstore-config
21992024-11-19T19:45:46.433ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47728
22002024-11-19T19:45:46.433ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47728 req_id = 06804f8c-f9c6-4c15-9514-95a753385109 response_code = 200 uri = /baseboard
22012024-11-19T19:45:56.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32803
22022024-11-19T19:45:56.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32803 req_id = a02fcdea-034b-4071-b8d4-9695d36a5df0 response_code = 200 uri = /vpc-routes
22032024-11-19T19:45:57.009ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
22042024-11-19T19:45:57.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32803 req_id = b178fc9c-c4cf-495c-93af-b34d5a82173b response_code = 204 uri = /eip-gateways
22052024-11-19T19:45:57.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48224
22062024-11-19T19:45:57.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48224 req_id = ba6636db-5225-4abf-9f7a-a56326fd5063 response_code = 200 uri = /v2p
22072024-11-19T19:45:57.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32803 req_id = e6048749-6c7e-4f17-8953-50feef1cc2dd response_code = 204 uri = /vpc-routes
22082024-11-19T19:45:57.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52447
22092024-11-19T19:45:57.305ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22102024-11-19T19:45:57.342ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22112024-11-19T19:45:57.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88576 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52447 req_id = 5044fa04-5274-4813-a5e7-1343f1c58368 response_code = 204 uri = /switch-ports
22122024-11-19T19:45:57.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50971
22132024-11-19T19:45:57.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52447 req_id = b1006d0b-5226-4c35-944f-59e85d02e02b response_code = 200 uri = /network-bootstore-config
22142024-11-19T19:45:57.394ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5b8bfa18-7354-4f55-a504-480af517e18d, kind: Service { id: b66ee542-3bb8-4a73-84f4-750c58e065cd }, name: Name("external-dns-b66ee542-3bb8-4a73-84f4-750c58e065cd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 138])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7dd645f-0047-411a-97d8-aca563c9c84b, kind: Service { id: 6805754c-e76e-4239-8505-cec4433c6625 }, name: Name("external-dns-6805754c-e76e-4239-8505-cec4433c6625"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3b3cb3e0-07fc-4857-ac35-656c692da813, kind: Service { id: 6880cb29-d555-4d40-84be-52baa0347d94 }, name: Name("nexus-6880cb29-d555-4d40-84be-52baa0347d94"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a9d89c40-50f5-46df-aa3f-9729aafbd4c1, kind: Service { id: 616e36c0-dd43-4cc2-ab3b-07823e2bc4d8 }, name: Name("nexus-616e36c0-dd43-4cc2-ab3b-07823e2bc4d8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3d55a5-b61f-48a6-b94d-766c7b25e0c2, kind: Service { id: 55c1d4bf-7793-4af3-b4d3-e162197a6fc3 }, name: Name("nexus-55c1d4bf-7793-4af3-b4d3-e162197a6fc3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22152024-11-19T19:45:57.394ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22162024-11-19T19:45:57.394ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22172024-11-19T19:45:57.394ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
22182024-11-19T19:45:57.394ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22192024-11-19T19:45:57.394ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22202024-11-19T19:45:57.394ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22212024-11-19T19:45:57.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 540 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50971 req_id = d2ffbc66-3e2e-44e6-8e7e-c1517b1a40d5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22222024-11-19T19:45:58.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49238
22232024-11-19T19:45:58.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49238 req_id = 34ada549-0986-40fb-9265-ed7a860b3585 response_code = 200 uri = /vpc-routes
22242024-11-19T19:45:58.120ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
22252024-11-19T19:45:58.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49238 req_id = 36bf9e15-553b-4a03-8fc5-0679a22364c6 response_code = 204 uri = /eip-gateways
22262024-11-19T19:45:58.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49238 req_id = 85840571-7477-4e2f-a12d-18a687b31867 response_code = 204 uri = /vpc-routes
22272024-11-19T19:45:58.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46213
22282024-11-19T19:45:58.259ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5b8bfa18-7354-4f55-a504-480af517e18d, kind: Service { id: b66ee542-3bb8-4a73-84f4-750c58e065cd }, name: Name("external-dns-b66ee542-3bb8-4a73-84f4-750c58e065cd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 138])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7dd645f-0047-411a-97d8-aca563c9c84b, kind: Service { id: 6805754c-e76e-4239-8505-cec4433c6625 }, name: Name("external-dns-6805754c-e76e-4239-8505-cec4433c6625"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3b3cb3e0-07fc-4857-ac35-656c692da813, kind: Service { id: 6880cb29-d555-4d40-84be-52baa0347d94 }, name: Name("nexus-6880cb29-d555-4d40-84be-52baa0347d94"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a9d89c40-50f5-46df-aa3f-9729aafbd4c1, kind: Service { id: 616e36c0-dd43-4cc2-ab3b-07823e2bc4d8 }, name: Name("nexus-616e36c0-dd43-4cc2-ab3b-07823e2bc4d8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3d55a5-b61f-48a6-b94d-766c7b25e0c2, kind: Service { id: 55c1d4bf-7793-4af3-b4d3-e162197a6fc3 }, name: Name("nexus-55c1d4bf-7793-4af3-b4d3-e162197a6fc3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22292024-11-19T19:45:58.259ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22302024-11-19T19:45:58.259ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22312024-11-19T19:45:58.259ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
22322024-11-19T19:45:58.260ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22332024-11-19T19:45:58.260ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22342024-11-19T19:45:58.260ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22352024-11-19T19:45:58.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46213 req_id = 9c07f4ea-a933-4a7e-b9fc-7c423411ee80 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22362024-11-19T19:45:58.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58944
22372024-11-19T19:45:58.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58944 req_id = cbe4cc55-12d3-4beb-848b-595c2fcde74c response_code = 200 uri = /v2p
22382024-11-19T19:45:58.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58063
22392024-11-19T19:45:58.376ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22402024-11-19T19:45:58.416ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22412024-11-19T19:45:58.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106044 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58063 req_id = 5ea87bcb-5e4d-405d-979a-cb2df2813f15 response_code = 204 uri = /switch-ports
22422024-11-19T19:45:58.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43076
22432024-11-19T19:45:58.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43076 req_id = 7fee0928-5fc2-47b0-9351-44cff362adf1 response_code = 200 uri = /vpc-routes
22442024-11-19T19:45:58.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58063 req_id = 22f47098-6829-421f-bf16-e60dc15231fb response_code = 200 uri = /network-bootstore-config
22452024-11-19T19:45:58.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36178
22462024-11-19T19:45:58.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36178 req_id = 7d1fcc77-81c6-4fce-84dd-b31837ade059 response_code = 200 uri = /v2p
22472024-11-19T19:45:58.589ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
22482024-11-19T19:45:58.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43076 req_id = b2488168-5d34-4985-b8c2-cfe6b9574659 response_code = 204 uri = /eip-gateways
22492024-11-19T19:45:58.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62013
22502024-11-19T19:45:58.595ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22512024-11-19T19:45:58.635ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22522024-11-19T19:45:58.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97983 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62013 req_id = 57f0efcc-ec40-4f52-a0cd-5f5e47259977 response_code = 204 uri = /switch-ports
22532024-11-19T19:45:58.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43076 req_id = 35868152-3522-4e62-94b1-1fc7043285a3 response_code = 204 uri = /vpc-routes
22542024-11-19T19:45:58.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62013 req_id = 6d3c1654-494b-470c-bf15-1140c568a0e8 response_code = 200 uri = /network-bootstore-config
22552024-11-19T19:45:58.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62611
22562024-11-19T19:45:58.874ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5b8bfa18-7354-4f55-a504-480af517e18d, kind: Service { id: b66ee542-3bb8-4a73-84f4-750c58e065cd }, name: Name("external-dns-b66ee542-3bb8-4a73-84f4-750c58e065cd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 138])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7dd645f-0047-411a-97d8-aca563c9c84b, kind: Service { id: 6805754c-e76e-4239-8505-cec4433c6625 }, name: Name("external-dns-6805754c-e76e-4239-8505-cec4433c6625"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3b3cb3e0-07fc-4857-ac35-656c692da813, kind: Service { id: 6880cb29-d555-4d40-84be-52baa0347d94 }, name: Name("nexus-6880cb29-d555-4d40-84be-52baa0347d94"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a9d89c40-50f5-46df-aa3f-9729aafbd4c1, kind: Service { id: 616e36c0-dd43-4cc2-ab3b-07823e2bc4d8 }, name: Name("nexus-616e36c0-dd43-4cc2-ab3b-07823e2bc4d8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3d55a5-b61f-48a6-b94d-766c7b25e0c2, kind: Service { id: 55c1d4bf-7793-4af3-b4d3-e162197a6fc3 }, name: Name("nexus-55c1d4bf-7793-4af3-b4d3-e162197a6fc3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22572024-11-19T19:45:58.874ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22582024-11-19T19:45:58.874ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22592024-11-19T19:45:58.874ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
22602024-11-19T19:45:58.874ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22612024-11-19T19:45:58.874ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22622024-11-19T19:45:58.874ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22632024-11-19T19:45:58.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62611 req_id = 62dca679-0d11-4959-ba78-37db87be4194 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22642024-11-19T19:46:16.472ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46405
22652024-11-19T19:46:16.472ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46405 req_id = 1ea9b0d5-6d37-4bae-a1c2-56dbb7fd5d89 response_code = 200 uri = /baseboard
22662024-11-19T19:46:26.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50066
22672024-11-19T19:46:26.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50066 req_id = 084946e6-16a4-48a5-9b86-dd8971bc1552 response_code = 200 uri = /vpc-routes
22682024-11-19T19:46:27.042ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
22692024-11-19T19:46:27.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50066 req_id = 19b0765c-5981-4912-91e5-a780fcb82e3b response_code = 204 uri = /eip-gateways
22702024-11-19T19:46:27.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40442
22712024-11-19T19:46:27.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40442 req_id = 675e53fa-d4ce-4dab-8acb-d8cff378bee9 response_code = 200 uri = /v2p
22722024-11-19T19:46:27.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50066 req_id = 5b359562-278a-4a97-84be-aefebb0e586d response_code = 204 uri = /vpc-routes
22732024-11-19T19:46:27.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41542
22742024-11-19T19:46:27.209ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22752024-11-19T19:46:27.249ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22762024-11-19T19:46:27.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95291 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41542 req_id = 2647d9f0-4df1-4a28-b02d-fecabe4f86d5 response_code = 204 uri = /switch-ports
22772024-11-19T19:46:27.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41542 req_id = 61d0132d-d462-406a-81d5-920c6501425f response_code = 200 uri = /network-bootstore-config
22782024-11-19T19:46:27.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38417
22792024-11-19T19:46:27.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38417 req_id = eab0f9a9-5e56-41af-abf5-8e5a7fffc9e5 response_code = 200 uri = /vpc-routes
22802024-11-19T19:46:27.961ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
22812024-11-19T19:46:27.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38417 req_id = 12832da2-1901-4d0b-a7a4-0c8b25e8f82f response_code = 204 uri = /eip-gateways
22822024-11-19T19:46:27.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38417 req_id = 19c4c599-412e-45de-b43d-9be587bb1323 response_code = 204 uri = /vpc-routes
22832024-11-19T19:46:28.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59741
22842024-11-19T19:46:28.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59741 req_id = 121dc0e2-bfa2-4a75-8a5e-9ee9b63b0075 response_code = 200 uri = /v2p
22852024-11-19T19:46:28.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60034
22862024-11-19T19:46:28.171ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22872024-11-19T19:46:28.210ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22882024-11-19T19:46:28.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94071 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60034 req_id = b02cec0e-436a-4da7-8408-0ddde5be3450 response_code = 204 uri = /switch-ports
22892024-11-19T19:46:28.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62179
22902024-11-19T19:46:28.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62179 req_id = 993da7cb-79a0-44c6-97ea-7d714b90da92 response_code = 200 uri = /v2p
22912024-11-19T19:46:28.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60034 req_id = 5e3f0cab-a5ef-4b2b-b07e-ba115ffbdc4a response_code = 200 uri = /network-bootstore-config
22922024-11-19T19:46:28.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55352
22932024-11-19T19:46:28.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55352 req_id = 938917fa-45e5-466c-a25f-5c7a607a1007 response_code = 200 uri = /vpc-routes
22942024-11-19T19:46:28.389ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
22952024-11-19T19:46:28.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55352 req_id = 6e5488bf-abab-4d73-a25c-efdee850add9 response_code = 204 uri = /eip-gateways
22962024-11-19T19:46:28.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55352 req_id = 57586bd0-0e9d-4bdd-8327-cdd8ae7dfb8d response_code = 204 uri = /vpc-routes
22972024-11-19T19:46:28.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52819
22982024-11-19T19:46:28.420ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22992024-11-19T19:46:28.457ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23002024-11-19T19:46:28.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87609 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52819 req_id = 12a37f21-1664-4b3e-a280-3f377545eb30 response_code = 204 uri = /switch-ports
23012024-11-19T19:46:28.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52819 req_id = cbcdf123-9d6a-4524-9b40-20081cc35dd9 response_code = 200 uri = /network-bootstore-config
23022024-11-19T19:46:40.434ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23032024-11-19T19:46:40.434ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23042024-11-19T19:46:40.464ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2727, tv_nsec: 752819355 } time_to_next_cleanup = 599.99999571s
23052024-11-19T19:46:46.505ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35989
23062024-11-19T19:46:46.505ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35989 req_id = 34962eb3-aaca-44ca-ad77-649c222d6e1f response_code = 200 uri = /baseboard
23072024-11-19T19:46:55.019ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23082024-11-19T19:46:57.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46579
23092024-11-19T19:46:57.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46579 req_id = 274f813b-709c-4196-922c-7c43d5699380 response_code = 200 uri = /vpc-routes
23102024-11-19T19:46:57.035ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
23112024-11-19T19:46:57.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46579 req_id = ad19df06-cb01-4633-9bbb-205a9fb523f2 response_code = 204 uri = /eip-gateways
23122024-11-19T19:46:57.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46579 req_id = b0d1aea3-1f75-47ba-a937-697a223ad2af response_code = 204 uri = /vpc-routes
23132024-11-19T19:46:57.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39986
23142024-11-19T19:46:57.116ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23152024-11-19T19:46:57.157ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23162024-11-19T19:46:57.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95813 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39986 req_id = 9470a22e-77b7-406d-b169-d18dc48d428c response_code = 204 uri = /switch-ports
23172024-11-19T19:46:57.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41053
23182024-11-19T19:46:57.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41053 req_id = 7550742a-bf79-4c53-9da8-7a4592a9da5d response_code = 200 uri = /v2p
23192024-11-19T19:46:57.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39986 req_id = 5db46b79-0747-4246-b799-47a45e507896 response_code = 200 uri = /network-bootstore-config
23202024-11-19T19:46:58.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45295
23212024-11-19T19:46:58.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45295 req_id = 54d86371-3e3b-41d7-b1ec-c1e7dfa22fde response_code = 200 uri = /vpc-routes
23222024-11-19T19:46:58.146ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
23232024-11-19T19:46:58.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45295 req_id = b112edc1-5c2f-4fdb-9e68-bbb7bec4da2b response_code = 204 uri = /eip-gateways
23242024-11-19T19:46:58.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45295 req_id = ea86b52b-d313-47f0-8d3c-cb79355361cf response_code = 204 uri = /vpc-routes
23252024-11-19T19:46:58.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55620
23262024-11-19T19:46:58.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55620 req_id = af7894ac-0823-4595-8905-69e8e4c24e02 response_code = 200 uri = /vpc-routes
23272024-11-19T19:46:58.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34704
23282024-11-19T19:46:58.277ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23292024-11-19T19:46:58.321ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23302024-11-19T19:46:58.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103212 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34704 req_id = 992d0e70-01d6-462b-afed-8be67ee8fed1 response_code = 204 uri = /switch-ports
23312024-11-19T19:46:58.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60592
23322024-11-19T19:46:58.380ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
23332024-11-19T19:46:58.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55620 req_id = 116c8b8d-b623-4e36-9c6b-3144db25b036 response_code = 204 uri = /eip-gateways
23342024-11-19T19:46:58.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34704 req_id = 4e528619-fd9e-4456-bf3c-0ccc4e3bea97 response_code = 200 uri = /network-bootstore-config
23352024-11-19T19:46:58.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60592 req_id = ccd48be2-8604-427a-a799-c87676c0f2d9 response_code = 200 uri = /v2p
23362024-11-19T19:46:58.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41078
23372024-11-19T19:46:58.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41078 req_id = 2c9e229f-0595-46d4-a2c0-38760b33983b response_code = 200 uri = /v2p
23382024-11-19T19:46:58.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55620 req_id = 97a82338-0004-4f42-b353-a36608188aa1 response_code = 204 uri = /vpc-routes
23392024-11-19T19:46:58.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53144
23402024-11-19T19:46:58.464ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23412024-11-19T19:46:58.499ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23422024-11-19T19:46:58.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86339 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53144 req_id = 8b4464d9-cddc-4475-9316-81a822d67633 response_code = 204 uri = /switch-ports
23432024-11-19T19:46:58.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53144 req_id = 03ffe6d0-562d-4e8e-9694-398beec59bef response_code = 200 uri = /network-bootstore-config
23442024-11-19T19:47:16.537ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59100
23452024-11-19T19:47:16.537ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59100 req_id = bffa5190-4ca7-4dfe-9402-5a563c412bf2 response_code = 200 uri = /baseboard
23462024-11-19T19:47:26.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44626
23472024-11-19T19:47:26.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44626 req_id = 2bb02679-ac12-4eff-b4a6-05a4bcd5df0b response_code = 200 uri = /vpc-routes
23482024-11-19T19:47:26.906ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
23492024-11-19T19:47:26.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44626 req_id = c4f522ef-2b13-4c24-bae5-0bb1f77c0629 response_code = 204 uri = /eip-gateways
23502024-11-19T19:47:26.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44626 req_id = 6e525db2-4555-469b-90a2-3d8c42ccdb1b response_code = 204 uri = /vpc-routes
23512024-11-19T19:47:27.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58632
23522024-11-19T19:47:27.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58632 req_id = c55d3e8f-7e9f-40d8-914e-bece176db987 response_code = 200 uri = /v2p
23532024-11-19T19:47:27.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46620
23542024-11-19T19:47:27.045ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23552024-11-19T19:47:27.085ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23562024-11-19T19:47:27.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101963 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46620 req_id = c01b63c5-9773-4a33-9a82-86789b69d844 response_code = 204 uri = /switch-ports
23572024-11-19T19:47:27.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46620 req_id = fca56ca3-27d5-4fbc-b1ac-cbf97aeb8cf0 response_code = 200 uri = /network-bootstore-config
23582024-11-19T19:47:28.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49512
23592024-11-19T19:47:28.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49512 req_id = 6827694e-b76d-4d45-b804-d3554953f248 response_code = 200 uri = /vpc-routes
23602024-11-19T19:47:28.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62249
23612024-11-19T19:47:28.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62249 req_id = 5c1d8514-6d73-4cb9-b828-96e4b12f4291 response_code = 200 uri = /v2p
23622024-11-19T19:47:28.100ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
23632024-11-19T19:47:28.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49512 req_id = bda9fa1b-f131-478d-99e4-ad7ccca5df63 response_code = 204 uri = /eip-gateways
23642024-11-19T19:47:28.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49512 req_id = 58ba9836-1d07-490e-9d01-5473415d5e58 response_code = 204 uri = /vpc-routes
23652024-11-19T19:47:28.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44230
23662024-11-19T19:47:28.139ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23672024-11-19T19:47:28.181ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23682024-11-19T19:47:28.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107023 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44230 req_id = 745caf63-a4de-45fa-b655-76aa71aa84de response_code = 204 uri = /switch-ports
23692024-11-19T19:47:28.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44230 req_id = fcbb0f0b-11c3-4815-aeb0-ac8ede703d31 response_code = 200 uri = /network-bootstore-config
23702024-11-19T19:47:28.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34286
23712024-11-19T19:47:28.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34286 req_id = 13f3af84-4b20-488d-9bda-917191a69d7e response_code = 200 uri = /vpc-routes
23722024-11-19T19:47:28.356ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
23732024-11-19T19:47:28.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34286 req_id = ae4b64aa-b442-4bd8-9e21-4ac91bda1846 response_code = 204 uri = /eip-gateways
23742024-11-19T19:47:28.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53275
23752024-11-19T19:47:28.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53275 req_id = 777af362-7fc2-465e-ab7d-73ac28b26a92 response_code = 200 uri = /v2p
23762024-11-19T19:47:28.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34286 req_id = f5ba647f-3f9d-47b4-a7b1-7a2f1ee05ae7 response_code = 204 uri = /vpc-routes
23772024-11-19T19:47:28.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55991
23782024-11-19T19:47:28.456ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23792024-11-19T19:47:28.498ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23802024-11-19T19:47:28.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110544 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55991 req_id = 35855308-a977-444a-b95d-7f72b76315cc response_code = 204 uri = /switch-ports
23812024-11-19T19:47:28.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55991 req_id = 00697312-d666-48fd-a468-ad0cbe6595a0 response_code = 200 uri = /network-bootstore-config
23822024-11-19T19:47:46.569ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41346
23832024-11-19T19:47:46.569ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41346 req_id = cdc3bffb-2cb2-423b-a4b2-4af3bc93c52a response_code = 200 uri = /baseboard
23842024-11-19T19:47:57.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33527
23852024-11-19T19:47:57.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33527 req_id = 3a87118c-5325-44f3-8104-aa794b2ad232 response_code = 200 uri = /vpc-routes
23862024-11-19T19:47:57.065ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
23872024-11-19T19:47:57.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33527 req_id = da24068f-a286-44d5-808b-17762d4a4ef4 response_code = 204 uri = /eip-gateways
23882024-11-19T19:47:57.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64190
23892024-11-19T19:47:57.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64190 req_id = 36cfae07-d50d-40a6-8a0b-f3b36b9ea022 response_code = 200 uri = /v2p
23902024-11-19T19:47:57.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33527 req_id = 1a6d54a5-bbf8-4913-b310-de7d37783b46 response_code = 204 uri = /vpc-routes
23912024-11-19T19:47:57.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59511
23922024-11-19T19:47:57.187ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23932024-11-19T19:47:57.229ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23942024-11-19T19:47:57.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101500 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59511 req_id = e8c5a74f-7455-49c5-b728-c1b3610a8e80 response_code = 204 uri = /switch-ports
23952024-11-19T19:47:57.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59511 req_id = 4342b01a-dfc9-43c7-a1d4-a6a9bbe409a3 response_code = 200 uri = /network-bootstore-config
23962024-11-19T19:47:58.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58069
23972024-11-19T19:47:58.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58069 req_id = c1b65e82-1daf-4209-aa45-5aa65e215505 response_code = 200 uri = /vpc-routes
23982024-11-19T19:47:58.198ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
23992024-11-19T19:47:58.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58069 req_id = 791665cd-3e48-49ae-af03-94dc1662e2f7 response_code = 204 uri = /eip-gateways
24002024-11-19T19:47:58.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39692
24012024-11-19T19:47:58.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39692 req_id = fa68bf05-bc15-467b-bb7f-e6cc3b83a5d6 response_code = 200 uri = /v2p
24022024-11-19T19:47:58.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58069 req_id = cdcfb05d-9c3b-4a51-9303-a27ff840e4c3 response_code = 204 uri = /vpc-routes
24032024-11-19T19:47:58.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60841
24042024-11-19T19:47:58.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60841 req_id = 107690e8-6dbd-4858-82e5-1d4f6fb8ac61 response_code = 200 uri = /vpc-routes
24052024-11-19T19:47:58.335ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
24062024-11-19T19:47:58.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60841 req_id = 67d72d0c-9334-48c7-a0be-d6feab7b57d3 response_code = 204 uri = /eip-gateways
24072024-11-19T19:47:58.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60841 req_id = 911e71ef-bf2a-4c97-9a40-daea7be4cda9 response_code = 204 uri = /vpc-routes
24082024-11-19T19:47:58.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54905
24092024-11-19T19:47:58.364ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24102024-11-19T19:47:58.404ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24112024-11-19T19:47:58.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98970 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54905 req_id = 8dea15da-7366-4774-8222-45dfac8d12d3 response_code = 204 uri = /switch-ports
24122024-11-19T19:47:58.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53586
24132024-11-19T19:47:58.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53586 req_id = 1a91b9fb-c7fb-463e-93f8-dd18e7e2647b response_code = 200 uri = /v2p
24142024-11-19T19:47:58.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54905 req_id = ba0e6a8a-fb5d-4d88-b913-6eb7c141dd55 response_code = 200 uri = /network-bootstore-config
24152024-11-19T19:47:58.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51662
24162024-11-19T19:47:58.472ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24172024-11-19T19:47:58.508ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24182024-11-19T19:47:58.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93686 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51662 req_id = 471bd9e3-a641-42c1-9604-125480dbc1c1 response_code = 204 uri = /switch-ports
24192024-11-19T19:47:58.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51662 req_id = 45271e51-1c64-48a8-95b7-30fec9f2b8e2 response_code = 200 uri = /network-bootstore-config
24202024-11-19T19:48:16.611ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35010
24212024-11-19T19:48:16.611ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35010 req_id = 44e95cb5-bd76-44fe-9ee5-17ec8421cba6 response_code = 200 uri = /baseboard
24222024-11-19T19:48:27.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56782
24232024-11-19T19:48:27.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56782 req_id = 1f14e88c-0e65-4bec-94ca-97a01a8a0a69 response_code = 200 uri = /vpc-routes
24242024-11-19T19:48:27.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60612
24252024-11-19T19:48:27.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60612 req_id = af88dccd-e9c5-4da2-82fc-3ea42d0dff42 response_code = 200 uri = /v2p
24262024-11-19T19:48:27.068ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
24272024-11-19T19:48:27.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56782 req_id = 88938fbf-b5fc-408e-acc9-4f95b95631c6 response_code = 204 uri = /eip-gateways
24282024-11-19T19:48:27.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56782 req_id = 9bdaeb5e-af4e-473d-bb97-97754dfb2aee response_code = 204 uri = /vpc-routes
24292024-11-19T19:48:27.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62631
24302024-11-19T19:48:27.082ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24312024-11-19T19:48:27.123ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24322024-11-19T19:48:27.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101510 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62631 req_id = 5f1108eb-7b94-44c1-a289-17cf189c4512 response_code = 204 uri = /switch-ports
24332024-11-19T19:48:27.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62631 req_id = 0df86d3d-b722-4a87-8884-f21f159e4996 response_code = 200 uri = /network-bootstore-config
24342024-11-19T19:48:28.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64158
24352024-11-19T19:48:28.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64158 req_id = a8b8d3d9-ac83-49d3-8c15-0342579c4fab response_code = 200 uri = /vpc-routes
24362024-11-19T19:48:28.036ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
24372024-11-19T19:48:28.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64158 req_id = 1d7eff54-08c3-44a4-8fd0-71fa1642d2c6 response_code = 204 uri = /eip-gateways
24382024-11-19T19:48:28.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64158 req_id = e62e6dea-3ad5-4433-8e32-11eaad1c8576 response_code = 204 uri = /vpc-routes
24392024-11-19T19:48:28.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58152
24402024-11-19T19:48:28.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58152 req_id = 6251f1e9-7b3c-42c6-9ee1-bb50a08b4569 response_code = 200 uri = /v2p
24412024-11-19T19:48:28.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41138
24422024-11-19T19:48:28.137ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24432024-11-19T19:48:28.179ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24442024-11-19T19:48:28.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112806 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41138 req_id = 3fff4fde-1ab3-427c-8826-0951a9f56460 response_code = 204 uri = /switch-ports
24452024-11-19T19:48:28.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43118
24462024-11-19T19:48:28.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43118 req_id = cde282bd-5f25-466b-b21b-8f1eeb6df07d response_code = 200 uri = /vpc-routes
24472024-11-19T19:48:28.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41138 req_id = a75f2eb1-a1a6-420a-aa24-5d4277b9af33 response_code = 200 uri = /network-bootstore-config
24482024-11-19T19:48:28.296ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
24492024-11-19T19:48:28.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43118 req_id = 2364a654-ddc9-4396-a19d-e479ec5de0ef response_code = 204 uri = /eip-gateways
24502024-11-19T19:48:28.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58180
24512024-11-19T19:48:28.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58180 req_id = af1e63e0-0e44-465d-bff5-4c1e68d9a38d response_code = 200 uri = /v2p
24522024-11-19T19:48:28.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43118 req_id = 0422729c-9f9c-4f83-bb48-aa739d2c35d9 response_code = 204 uri = /vpc-routes
24532024-11-19T19:48:28.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61149
24542024-11-19T19:48:28.397ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24552024-11-19T19:48:28.433ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24562024-11-19T19:48:28.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88193 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61149 req_id = 72cb2d74-6fa2-4f64-9acd-c9712d9a0a14 response_code = 204 uri = /switch-ports
24572024-11-19T19:48:28.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61149 req_id = 9b61fbad-a24a-4ef9-b62b-6172753fbfd4 response_code = 200 uri = /network-bootstore-config
24582024-11-19T19:48:46.644ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64346
24592024-11-19T19:48:46.644ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64346 req_id = e915e872-a807-4716-b8bc-2f639d4b4780 response_code = 200 uri = /baseboard
24602024-11-19T19:48:48.831ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
24612024-11-19T19:48:48.833ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
24622024-11-19T19:48:56.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45789
24632024-11-19T19:48:56.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45789 req_id = ca96cdd3-d856-461a-ba33-afea70a5e609 response_code = 200 uri = /vpc-routes
24642024-11-19T19:48:57.041ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
24652024-11-19T19:48:57.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45789 req_id = 90252c9b-de58-45cd-8fa6-3681aa462e4c response_code = 204 uri = /eip-gateways
24662024-11-19T19:48:57.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59544
24672024-11-19T19:48:57.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59544 req_id = 8f6dce0b-451f-4628-a6be-9d8f0f366088 response_code = 200 uri = /v2p
24682024-11-19T19:48:57.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45789 req_id = af814b62-0ab6-4b94-8bbc-16e6462d332f response_code = 204 uri = /vpc-routes
24692024-11-19T19:48:57.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58921
24702024-11-19T19:48:57.198ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24712024-11-19T19:48:57.240ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24722024-11-19T19:48:57.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103777 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58921 req_id = d53d0674-4b01-486c-b897-f72891c4036d response_code = 204 uri = /switch-ports
24732024-11-19T19:48:57.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58921 req_id = eb3c578b-5035-49d5-bb4d-c72a6a016a31 response_code = 200 uri = /network-bootstore-config
24742024-11-19T19:48:58.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34690
24752024-11-19T19:48:58.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34690 req_id = e564b13d-8894-422a-9c43-105e1086eea9 response_code = 200 uri = /vpc-routes
24762024-11-19T19:48:58.078ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
24772024-11-19T19:48:58.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34690 req_id = 8f221e53-3944-4a7c-b513-3f07f65ae9cc response_code = 204 uri = /eip-gateways
24782024-11-19T19:48:58.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34690 req_id = 6bb54918-6a2f-46fd-91cf-ccd6496c56c2 response_code = 204 uri = /vpc-routes
24792024-11-19T19:48:58.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56348
24802024-11-19T19:48:58.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56348 req_id = a13c13b6-a277-490b-a395-0957059f37d0 response_code = 200 uri = /v2p
24812024-11-19T19:48:58.282ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36039
24822024-11-19T19:48:58.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36039 req_id = 8be74e08-4fc7-430a-820b-207b890aefd3 response_code = 200 uri = /vpc-routes
24832024-11-19T19:48:58.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40716
24842024-11-19T19:48:58.327ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24852024-11-19T19:48:58.365ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24862024-11-19T19:48:58.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90442 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40716 req_id = 5e08ce89-9f66-4e03-9585-eb7a34c3ac70 response_code = 204 uri = /switch-ports
24872024-11-19T19:48:58.417ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
24882024-11-19T19:48:58.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36039 req_id = d8c1ca2d-7bbd-4be7-bcf0-69869e551f95 response_code = 204 uri = /eip-gateways
24892024-11-19T19:48:58.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40716 req_id = d512cc4c-4946-41b8-8103-bcdebdca4948 response_code = 200 uri = /network-bootstore-config
24902024-11-19T19:48:58.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42410
24912024-11-19T19:48:58.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42410 req_id = 11ddfe36-fd3a-4730-86d1-3026acfe48d9 response_code = 200 uri = /v2p
24922024-11-19T19:48:58.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36039 req_id = e0c782af-e12a-4c1d-834b-733f31608f4a response_code = 204 uri = /vpc-routes
24932024-11-19T19:48:58.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55470
24942024-11-19T19:48:58.482ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24952024-11-19T19:48:58.520ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24962024-11-19T19:48:58.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95850 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55470 req_id = 1e02f95f-d5f0-44ea-9aeb-78c61bcf76f0 response_code = 204 uri = /switch-ports
24972024-11-19T19:48:58.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55470 req_id = be2aaa71-8096-4935-bb9a-87002cea1c15 response_code = 200 uri = /network-bootstore-config
24982024-11-19T19:48:58.831ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
24992024-11-19T19:48:58.832ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25002024-11-19T19:48:58.835ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25012024-11-19T19:48:58.836ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25022024-11-19T19:49:08.834ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25032024-11-19T19:49:08.835ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25042024-11-19T19:49:08.838ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25052024-11-19T19:49:08.840ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25062024-11-19T19:49:16.677ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36473
25072024-11-19T19:49:16.677ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36473 req_id = ffcb0445-14bc-4d3b-830f-89f9b937d34e response_code = 200 uri = /baseboard
25082024-11-19T19:49:18.839ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25092024-11-19T19:49:18.839ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25102024-11-19T19:49:18.842ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25112024-11-19T19:49:18.845ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25122024-11-19T19:49:26.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44310
25132024-11-19T19:49:26.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44310 req_id = 86d4e1ed-2aa6-4d8c-9390-a2905de06eaa response_code = 200 uri = /vpc-routes
25142024-11-19T19:49:26.985ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
25152024-11-19T19:49:26.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44310 req_id = 622bc43c-2ef4-4bf5-bda7-34601b87dae6 response_code = 204 uri = /eip-gateways
25162024-11-19T19:49:26.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44310 req_id = 45702248-3e87-4033-9942-ec447d616cfa response_code = 204 uri = /vpc-routes
25172024-11-19T19:49:27.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62732
25182024-11-19T19:49:27.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62732 req_id = f1f358bd-12a5-4a86-bf16-36dc3b72f889 response_code = 200 uri = /v2p
25192024-11-19T19:49:27.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45731
25202024-11-19T19:49:27.090ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25212024-11-19T19:49:27.132ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25222024-11-19T19:49:27.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106204 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45731 req_id = 65305745-a35d-4a2c-940d-e39c541e17d0 response_code = 204 uri = /switch-ports
25232024-11-19T19:49:27.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45731 req_id = bb276449-3a55-463f-862c-b445a504fe40 response_code = 200 uri = /network-bootstore-config
25242024-11-19T19:49:28.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34583
25252024-11-19T19:49:28.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34583 req_id = 2a627f4d-0d58-41a6-9f71-46b87bd1327b response_code = 200 uri = /vpc-routes
25262024-11-19T19:49:28.076ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
25272024-11-19T19:49:28.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34583 req_id = 0ef4ceea-bde2-44c6-95d2-037511415b7f response_code = 204 uri = /eip-gateways
25282024-11-19T19:49:28.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34583 req_id = b2c37bad-0046-4f61-9dd4-46658c852e70 response_code = 204 uri = /vpc-routes
25292024-11-19T19:49:28.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34264
25302024-11-19T19:49:28.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34264 req_id = 9ae919b2-1c58-427d-8be8-9be14f722ff3 response_code = 200 uri = /vpc-routes
25312024-11-19T19:49:28.118ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
25322024-11-19T19:49:28.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34264 req_id = af797d78-9f3a-4afa-8b8b-76876283aad2 response_code = 204 uri = /eip-gateways
25332024-11-19T19:49:28.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34264 req_id = 284a5c00-45ef-47a6-ab12-961fc8ca4091 response_code = 204 uri = /vpc-routes
25342024-11-19T19:49:28.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57346
25352024-11-19T19:49:28.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57346 req_id = 62f45a87-e9c2-45bf-a630-9143c9b92a64 response_code = 200 uri = /v2p
25362024-11-19T19:49:28.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64156
25372024-11-19T19:49:28.170ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25382024-11-19T19:49:28.215ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25392024-11-19T19:49:28.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114351 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64156 req_id = 3d1d27cc-441c-4de3-94b1-aa95f914b8a1 response_code = 204 uri = /switch-ports
25402024-11-19T19:49:28.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45320
25412024-11-19T19:49:28.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45320 req_id = e40e3a87-0f84-4c37-8127-306ab8d29152 response_code = 200 uri = /v2p
25422024-11-19T19:49:28.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64156 req_id = 47bb5011-462e-41c1-89ab-5f9686eb590a response_code = 200 uri = /network-bootstore-config
25432024-11-19T19:49:28.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35340
25442024-11-19T19:49:28.286ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25452024-11-19T19:49:28.329ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25462024-11-19T19:49:28.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112120 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35340 req_id = 584673bf-424e-450e-aa89-54fb613f6141 response_code = 204 uri = /switch-ports
25472024-11-19T19:49:28.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35340 req_id = b924849a-b27b-4b49-8307-3f58e451b9da response_code = 200 uri = /network-bootstore-config
25482024-11-19T19:49:28.843ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25492024-11-19T19:49:28.844ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25502024-11-19T19:49:28.847ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25512024-11-19T19:49:28.848ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25522024-11-19T19:49:38.847ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25532024-11-19T19:49:38.848ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25542024-11-19T19:49:38.851ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25552024-11-19T19:49:38.852ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25562024-11-19T19:49:46.710ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33325
25572024-11-19T19:49:46.711ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33325 req_id = 2fe8cdc2-1444-4202-80c6-19ed1dc522aa response_code = 200 uri = /baseboard
25582024-11-19T19:49:48.852ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25592024-11-19T19:49:48.853ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25602024-11-19T19:49:48.856ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25612024-11-19T19:49:48.857ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25622024-11-19T19:49:56.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45253
25632024-11-19T19:49:56.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45253 req_id = cfdbe7e1-3f94-491c-8a0a-7c98d85f4909 response_code = 200 uri = /vpc-routes
25642024-11-19T19:49:56.989ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
25652024-11-19T19:49:56.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45253 req_id = ad430b9b-29a2-4d17-8ec4-f6f18169f138 response_code = 204 uri = /eip-gateways
25662024-11-19T19:49:56.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45253 req_id = 5e898634-18d8-4ac4-9815-e263fac22615 response_code = 204 uri = /vpc-routes
25672024-11-19T19:49:57.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37590
25682024-11-19T19:49:57.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37590 req_id = 55715704-ed28-4338-8023-910dcd97e30e response_code = 200 uri = /v2p
25692024-11-19T19:49:57.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47721
25702024-11-19T19:49:57.245ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25712024-11-19T19:49:57.284ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25722024-11-19T19:49:57.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101883 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47721 req_id = 4b64a89b-c1af-42ac-a19b-458d870eed18 response_code = 204 uri = /switch-ports
25732024-11-19T19:49:57.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47721 req_id = dd7b3847-de78-4748-9d5e-27dc5d068fdc response_code = 200 uri = /network-bootstore-config
25742024-11-19T19:49:58.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35573
25752024-11-19T19:49:58.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35573 req_id = ed69c8ef-2cf1-48c2-814d-ca79a2e7fe70 response_code = 200 uri = /vpc-routes
25762024-11-19T19:49:58.177ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
25772024-11-19T19:49:58.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35573 req_id = b04aa302-9c49-43a2-80c7-433c8b268be2 response_code = 204 uri = /eip-gateways
25782024-11-19T19:49:58.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35573 req_id = 4b8df44c-89ae-4367-9802-983b610026b6 response_code = 204 uri = /vpc-routes
25792024-11-19T19:49:58.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46657
25802024-11-19T19:49:58.261ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25812024-11-19T19:49:58.304ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25822024-11-19T19:49:58.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112915 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46657 req_id = 93cf7198-28e9-4625-a50b-ee7a16116722 response_code = 204 uri = /switch-ports
25832024-11-19T19:49:58.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41906
25842024-11-19T19:49:58.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46657 req_id = f1859d66-4d79-434f-9399-467d63588688 response_code = 200 uri = /network-bootstore-config
25852024-11-19T19:49:58.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41906 req_id = d617f974-3acc-4932-b8e9-e97a3a50cd3f response_code = 200 uri = /v2p
25862024-11-19T19:49:58.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61469
25872024-11-19T19:49:58.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61469 req_id = e6ffb2c7-072b-48b3-b6d2-a1b2f805d476 response_code = 200 uri = /vpc-routes
25882024-11-19T19:49:58.507ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
25892024-11-19T19:49:58.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61469 req_id = 37b4c929-7cf4-4284-92ac-efa17db3a789 response_code = 204 uri = /eip-gateways
25902024-11-19T19:49:58.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47950
25912024-11-19T19:49:58.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47950 req_id = b52afe88-535d-4dde-b20f-61883db4c258 response_code = 200 uri = /v2p
25922024-11-19T19:49:58.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61469 req_id = 2b433bbf-5126-4261-b4a5-fe3588e4a8f9 response_code = 204 uri = /vpc-routes
25932024-11-19T19:49:58.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51233
25942024-11-19T19:49:58.594ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25952024-11-19T19:49:58.635ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25962024-11-19T19:49:58.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94553 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51233 req_id = c2ffea5d-3a6b-419a-b27a-e3175418eb64 response_code = 204 uri = /switch-ports
25972024-11-19T19:49:58.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51233 req_id = 7326050e-d596-490a-ab32-e53752b2be38 response_code = 200 uri = /network-bootstore-config
25982024-11-19T19:49:58.857ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
25992024-11-19T19:49:58.858ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26002024-11-19T19:49:58.861ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26012024-11-19T19:49:58.862ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26022024-11-19T19:50:08.861ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26032024-11-19T19:50:08.862ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26042024-11-19T19:50:08.865ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26052024-11-19T19:50:08.866ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26062024-11-19T19:50:16.747ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53888
26072024-11-19T19:50:16.747ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53888 req_id = 989d3b28-6fbd-4929-a024-1f032ab5b481 response_code = 200 uri = /baseboard
26082024-11-19T19:50:18.864ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26092024-11-19T19:50:18.865ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26102024-11-19T19:50:18.868ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26112024-11-19T19:50:18.869ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26122024-11-19T19:50:26.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62868
26132024-11-19T19:50:26.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62868 req_id = 1788d12d-5e76-4e6a-9d05-368ea0ca13b3 response_code = 200 uri = /vpc-routes
26142024-11-19T19:50:26.957ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
26152024-11-19T19:50:26.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62868 req_id = 0d3c2083-5320-4a31-ab3d-d592335c2152 response_code = 204 uri = /eip-gateways
26162024-11-19T19:50:27.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58849
26172024-11-19T19:50:27.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58849 req_id = 1d59f0ba-569d-45a6-a205-2b4eafa199eb response_code = 200 uri = /v2p
26182024-11-19T19:50:27.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62868 req_id = 569fbaaf-b06e-4c92-8401-faa342bdd517 response_code = 204 uri = /vpc-routes
26192024-11-19T19:50:27.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43706
26202024-11-19T19:50:27.080ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26212024-11-19T19:50:27.119ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26222024-11-19T19:50:27.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101033 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43706 req_id = ccfb5274-040b-48ac-9301-4d683c7426ea response_code = 204 uri = /switch-ports
26232024-11-19T19:50:27.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43706 req_id = 52020485-cb38-403c-b171-f8e30b10eee3 response_code = 200 uri = /network-bootstore-config
26242024-11-19T19:50:27.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39878
26252024-11-19T19:50:27.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39878 req_id = 4ca02acb-e611-4db2-80f4-b5c25b5e57a1 response_code = 200 uri = /vpc-routes
26262024-11-19T19:50:27.980ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
26272024-11-19T19:50:27.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39878 req_id = 97ea53f9-9a97-4f8a-b4ce-a25347d44731 response_code = 204 uri = /eip-gateways
26282024-11-19T19:50:28.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39878 req_id = 3a89221d-0b84-4164-a80c-3f56509bbb47 response_code = 204 uri = /vpc-routes
26292024-11-19T19:50:28.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59593
26302024-11-19T19:50:28.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59593 req_id = 9d8a4477-751e-4d9e-a029-262980fa1804 response_code = 200 uri = /v2p
26312024-11-19T19:50:28.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47005
26322024-11-19T19:50:28.111ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26332024-11-19T19:50:28.152ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26342024-11-19T19:50:28.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99103 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47005 req_id = 55413a7c-921e-450c-9d5b-2ab84f7c2723 response_code = 204 uri = /switch-ports
26352024-11-19T19:50:28.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60276
26362024-11-19T19:50:28.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60276 req_id = 73fc9d0e-e31a-4e61-9beb-2e022c38ac79 response_code = 200 uri = /vpc-routes
26372024-11-19T19:50:28.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47005 req_id = ff2b2d53-670c-459c-8b3d-982a625c694c response_code = 200 uri = /network-bootstore-config
26382024-11-19T19:50:28.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33312
26392024-11-19T19:50:28.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33312 req_id = b714471e-9039-46dd-b3cd-c75a26ad5f0e response_code = 200 uri = /v2p
26402024-11-19T19:50:28.251ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
26412024-11-19T19:50:28.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60276 req_id = a28f0863-9900-4e58-89fc-6f310f3aa7ae response_code = 204 uri = /eip-gateways
26422024-11-19T19:50:28.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60276 req_id = f58dfe48-5fd0-4d49-9378-7cbc066d2808 response_code = 204 uri = /vpc-routes
26432024-11-19T19:50:28.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42587
26442024-11-19T19:50:28.294ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26452024-11-19T19:50:28.333ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26462024-11-19T19:50:28.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96001 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42587 req_id = 44efa2f1-5df1-4e63-b428-cad5a83dffba response_code = 204 uri = /switch-ports
26472024-11-19T19:50:28.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42587 req_id = 183a8a14-5249-4a08-9894-a12764586d75 response_code = 200 uri = /network-bootstore-config
26482024-11-19T19:50:28.868ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26492024-11-19T19:50:28.869ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26502024-11-19T19:50:28.872ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26512024-11-19T19:50:28.873ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26522024-11-19T19:50:38.873ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26532024-11-19T19:50:38.873ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26542024-11-19T19:50:38.876ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26552024-11-19T19:50:38.877ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26562024-11-19T19:50:46.780ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33793
26572024-11-19T19:50:46.780ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33793 req_id = 8b201d0f-ffcb-4d94-b531-c417fc5ebde1 response_code = 200 uri = /baseboard
26582024-11-19T19:50:48.876ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26592024-11-19T19:50:48.877ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26602024-11-19T19:50:48.880ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26612024-11-19T19:50:48.881ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
26622024-11-19T19:50:57.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55900
26632024-11-19T19:50:57.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55900 req_id = 1c863a09-5bce-4a91-99f4-3890dc56dfac response_code = 200 uri = /vpc-routes
26642024-11-19T19:50:57.199ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
26652024-11-19T19:50:57.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55900 req_id = 90e3657f-85cc-4376-82b3-c669f59dbae0 response_code = 204 uri = /eip-gateways
26662024-11-19T19:50:57.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59368
26672024-11-19T19:50:57.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59368 req_id = d47d2ac7-d6e5-45c4-983b-16fd77f3cb1c response_code = 200 uri = /v2p
26682024-11-19T19:50:57.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55900 req_id = 1f70253e-cec6-4ec4-bd86-2702fcdd4144 response_code = 204 uri = /vpc-routes
26692024-11-19T19:50:57.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52558
26702024-11-19T19:50:57.307ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26712024-11-19T19:50:57.353ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26722024-11-19T19:50:57.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109078 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52558 req_id = d287d6a7-4cf8-437f-98d6-88901321056d response_code = 204 uri = /switch-ports
26732024-11-19T19:50:57.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52558 req_id = b2375ce1-f846-4673-a512-81952d5c4603 response_code = 200 uri = /network-bootstore-config
26742024-11-19T19:50:57.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56970
26752024-11-19T19:50:57.423ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5b8bfa18-7354-4f55-a504-480af517e18d, kind: Service { id: b66ee542-3bb8-4a73-84f4-750c58e065cd }, name: Name("external-dns-b66ee542-3bb8-4a73-84f4-750c58e065cd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 138])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7dd645f-0047-411a-97d8-aca563c9c84b, kind: Service { id: 6805754c-e76e-4239-8505-cec4433c6625 }, name: Name("external-dns-6805754c-e76e-4239-8505-cec4433c6625"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3b3cb3e0-07fc-4857-ac35-656c692da813, kind: Service { id: 6880cb29-d555-4d40-84be-52baa0347d94 }, name: Name("nexus-6880cb29-d555-4d40-84be-52baa0347d94"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a9d89c40-50f5-46df-aa3f-9729aafbd4c1, kind: Service { id: 616e36c0-dd43-4cc2-ab3b-07823e2bc4d8 }, name: Name("nexus-616e36c0-dd43-4cc2-ab3b-07823e2bc4d8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3d55a5-b61f-48a6-b94d-766c7b25e0c2, kind: Service { id: 55c1d4bf-7793-4af3-b4d3-e162197a6fc3 }, name: Name("nexus-55c1d4bf-7793-4af3-b4d3-e162197a6fc3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26762024-11-19T19:50:57.423ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26772024-11-19T19:50:57.423ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26782024-11-19T19:50:57.423ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
26792024-11-19T19:50:57.423ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26802024-11-19T19:50:57.423ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26812024-11-19T19:50:57.423ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26822024-11-19T19:50:57.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 396 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56970 req_id = 0e60183d-6274-46e0-84dd-759eb51502ec response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26832024-11-19T19:50:58.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43015
26842024-11-19T19:50:58.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43015 req_id = 2dd47239-4d93-46e1-987d-b6c2239d525b response_code = 200 uri = /vpc-routes
26852024-11-19T19:50:58.225ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
26862024-11-19T19:50:58.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43015 req_id = 53d776f7-a634-4fa5-886e-78fe530fd15e response_code = 204 uri = /eip-gateways
26872024-11-19T19:50:58.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61067
26882024-11-19T19:50:58.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61067 req_id = 736a76b2-559d-4b62-b960-91170f693436 response_code = 200 uri = /v2p
26892024-11-19T19:50:58.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43015 req_id = 49916421-fb0b-47ac-b785-3ececf2cc25e response_code = 204 uri = /vpc-routes
26902024-11-19T19:50:58.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62780
26912024-11-19T19:50:58.348ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26922024-11-19T19:50:58.348ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26932024-11-19T19:50:58.348ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json file = common/src/ledger.rs:178
26942024-11-19T19:50:58.349ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json file = common/src/ledger.rs:178
26952024-11-19T19:50:58.365ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26962024-11-19T19:50:58.365ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_a60d50c5-1d31-4171-ba2e-661c260a4561
26972024-11-19T19:50:58.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61742
26982024-11-19T19:50:58.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61742 req_id = cfcb04df-130f-4d73-9cc3-11a6855c6073 response_code = 200 uri = /vpc-routes
26992024-11-19T19:50:58.397ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27002024-11-19T19:50:58.397ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_be436df4-34a1-4101-90ff-be2f8ef7e824
27012024-11-19T19:50:58.427ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27022024-11-19T19:50:58.427ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_af234a87-284a-4af4-aac4-6b58ea279f05
27032024-11-19T19:50:58.432ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
27042024-11-19T19:50:58.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 774 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61742 req_id = d23aa828-d112-4b8e-a4b6-54e1c177b9cd response_code = 204 uri = /eip-gateways
27052024-11-19T19:50:58.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61742 req_id = e684a874-fc2f-45ac-a7ca-947732933662 response_code = 204 uri = /vpc-routes
27062024-11-19T19:50:58.459ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27072024-11-19T19:50:58.459ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_43c663f2-b051-403e-bcad-e419348a9017
27082024-11-19T19:50:58.489ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27092024-11-19T19:50:58.489ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c
27102024-11-19T19:50:58.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56218
27112024-11-19T19:50:58.504ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27122024-11-19T19:50:58.504ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27132024-11-19T19:50:58.504ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json file = common/src/ledger.rs:178
27142024-11-19T19:50:58.510ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json file = common/src/ledger.rs:178
27152024-11-19T19:50:58.518ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27162024-11-19T19:50:58.518ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b5075ce0-4de0-43fe-a8e8-40bff047022b
27172024-11-19T19:50:58.533ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27182024-11-19T19:50:58.533ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_a60d50c5-1d31-4171-ba2e-661c260a4561
27192024-11-19T19:50:58.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59474
27202024-11-19T19:50:58.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59474 req_id = 5cdaf4d9-68ea-4767-a84c-f269039d108f response_code = 200 uri = /v2p
27212024-11-19T19:50:58.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42002
27222024-11-19T19:50:58.559ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27232024-11-19T19:50:58.559ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27242024-11-19T19:50:58.559ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/config/omicron-zones.json file = common/src/ledger.rs:178
27252024-11-19T19:50:58.560ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/config/omicron-zones.json file = common/src/ledger.rs:178
27262024-11-19T19:50:58.564ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27272024-11-19T19:50:58.564ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_be436df4-34a1-4101-90ff-be2f8ef7e824
27282024-11-19T19:50:58.582ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27292024-11-19T19:50:58.582ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fa881b81-fb55-465b-a7d1-159614622ca4
27302024-11-19T19:50:58.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34347
27312024-11-19T19:50:58.594ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5b8bfa18-7354-4f55-a504-480af517e18d, kind: Service { id: b66ee542-3bb8-4a73-84f4-750c58e065cd }, name: Name("external-dns-b66ee542-3bb8-4a73-84f4-750c58e065cd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 138])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7dd645f-0047-411a-97d8-aca563c9c84b, kind: Service { id: 6805754c-e76e-4239-8505-cec4433c6625 }, name: Name("external-dns-6805754c-e76e-4239-8505-cec4433c6625"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3b3cb3e0-07fc-4857-ac35-656c692da813, kind: Service { id: 6880cb29-d555-4d40-84be-52baa0347d94 }, name: Name("nexus-6880cb29-d555-4d40-84be-52baa0347d94"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a9d89c40-50f5-46df-aa3f-9729aafbd4c1, kind: Service { id: 616e36c0-dd43-4cc2-ab3b-07823e2bc4d8 }, name: Name("nexus-616e36c0-dd43-4cc2-ab3b-07823e2bc4d8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3d55a5-b61f-48a6-b94d-766c7b25e0c2, kind: Service { id: 55c1d4bf-7793-4af3-b4d3-e162197a6fc3 }, name: Name("nexus-55c1d4bf-7793-4af3-b4d3-e162197a6fc3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27322024-11-19T19:50:58.594ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27332024-11-19T19:50:58.594ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27342024-11-19T19:50:58.594ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27352024-11-19T19:50:58.594ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27362024-11-19T19:50:58.594ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27372024-11-19T19:50:58.594ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27382024-11-19T19:50:58.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 774 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34347 req_id = d9125fcb-3cdd-404b-abfd-7560ebfd1fee response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27392024-11-19T19:50:58.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64638
27402024-11-19T19:50:58.596ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27412024-11-19T19:50:58.604ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a60d50c5-1d31-4171-ba2e-661c260a4561 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27422024-11-19T19:50:58.604ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_a60d50c5-1d31-4171-ba2e-661c260a4561
27432024-11-19T19:50:58.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50999
27442024-11-19T19:50:58.628ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27452024-11-19T19:50:58.628ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_af234a87-284a-4af4-aac4-6b58ea279f05
27462024-11-19T19:50:58.645ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27472024-11-19T19:50:58.645ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_5d346fc3-b1ff-469c-a353-925addba06e4
27482024-11-19T19:50:58.655ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27492024-11-19T19:50:58.662ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: be436df4-34a1-4101-90ff-be2f8ef7e824 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27502024-11-19T19:50:58.662ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_be436df4-34a1-4101-90ff-be2f8ef7e824
27512024-11-19T19:50:58.680ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27522024-11-19T19:50:58.680ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_43c663f2-b051-403e-bcad-e419348a9017
27532024-11-19T19:50:58.699ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27542024-11-19T19:50:58.699ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3cdbf8c9-3584-411d-8acb-3e587708315a
27552024-11-19T19:50:58.717ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: af234a87-284a-4af4-aac4-6b58ea279f05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27562024-11-19T19:50:58.717ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_af234a87-284a-4af4-aac4-6b58ea279f05
27572024-11-19T19:50:58.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 375209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62780 req_id = 2bb5b37d-a697-4def-bb72-6279e50c50a7 response_code = 200 uri = /inventory
27582024-11-19T19:50:58.733ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27592024-11-19T19:50:58.733ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c
27602024-11-19T19:50:58.744ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27612024-11-19T19:50:58.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148058 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64638 req_id = 74851803-dfc7-4694-b5be-66241efcccf0 response_code = 204 uri = /switch-ports
27622024-11-19T19:50:58.754ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 43c663f2-b051-403e-bcad-e419348a9017 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27632024-11-19T19:50:58.754ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_43c663f2-b051-403e-bcad-e419348a9017
27642024-11-19T19:50:58.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5472 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64638 req_id = 072f9b23-546e-4ccd-bf88-80524820260e response_code = 200 uri = /network-bootstore-config
27652024-11-19T19:50:58.770ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27662024-11-19T19:50:58.770ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b5075ce0-4de0-43fe-a8e8-40bff047022b
27672024-11-19T19:50:58.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62686
27682024-11-19T19:50:58.785ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5b8bfa18-7354-4f55-a504-480af517e18d, kind: Service { id: b66ee542-3bb8-4a73-84f4-750c58e065cd }, name: Name("external-dns-b66ee542-3bb8-4a73-84f4-750c58e065cd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 138])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7dd645f-0047-411a-97d8-aca563c9c84b, kind: Service { id: 6805754c-e76e-4239-8505-cec4433c6625 }, name: Name("external-dns-6805754c-e76e-4239-8505-cec4433c6625"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 101])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3b3cb3e0-07fc-4857-ac35-656c692da813, kind: Service { id: 6880cb29-d555-4d40-84be-52baa0347d94 }, name: Name("nexus-6880cb29-d555-4d40-84be-52baa0347d94"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 194])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a9d89c40-50f5-46df-aa3f-9729aafbd4c1, kind: Service { id: 616e36c0-dd43-4cc2-ab3b-07823e2bc4d8 }, name: Name("nexus-616e36c0-dd43-4cc2-ab3b-07823e2bc4d8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3d55a5-b61f-48a6-b94d-766c7b25e0c2, kind: Service { id: 55c1d4bf-7793-4af3-b4d3-e162197a6fc3 }, name: Name("nexus-55c1d4bf-7793-4af3-b4d3-e162197a6fc3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 132])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27692024-11-19T19:50:58.785ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27702024-11-19T19:50:58.785ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27712024-11-19T19:50:58.785ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27722024-11-19T19:50:58.785ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27732024-11-19T19:50:58.785ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27742024-11-19T19:50:58.785ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27752024-11-19T19:50:58.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 463 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62686 req_id = d4427e5c-4c67-4f3b-a298-ddf56b3fb865 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27762024-11-19T19:50:58.790ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27772024-11-19T19:50:58.801ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27782024-11-19T19:50:58.801ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fa881b81-fb55-465b-a7d1-159614622ca4
27792024-11-19T19:50:58.817ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f1d7fa4a-6150-4e79-a410-b71fd3b63c5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27802024-11-19T19:50:58.817ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f1d7fa4a-6150-4e79-a410-b71fd3b63c5c
27812024-11-19T19:50:58.842ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27822024-11-19T19:50:58.843ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_5d346fc3-b1ff-469c-a353-925addba06e4
27832024-11-19T19:50:58.860ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5075ce0-4de0-43fe-a8e8-40bff047022b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27842024-11-19T19:50:58.860ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_b5075ce0-4de0-43fe-a8e8-40bff047022b
27852024-11-19T19:50:58.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242795 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50999 req_id = 73c42c78-fe6e-4185-a35a-70bdc409c126 response_code = 204 uri = /switch-ports
27862024-11-19T19:50:58.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50999 req_id = 2b33f17f-c553-4522-a1df-e7348470001d response_code = 200 uri = /network-bootstore-config
27872024-11-19T19:50:58.889ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
27882024-11-19T19:50:58.890ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
27892024-11-19T19:50:58.890ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa881b81-fb55-465b-a7d1-159614622ca4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27902024-11-19T19:50:58.890ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_fa881b81-fb55-465b-a7d1-159614622ca4
27912024-11-19T19:50:58.899ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
27922024-11-19T19:50:58.901ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
27932024-11-19T19:50:58.906ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27942024-11-19T19:50:58.906ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3cdbf8c9-3584-411d-8acb-3e587708315a
27952024-11-19T19:50:58.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 428321 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56218 req_id = d6b67cf2-2cd6-4d2d-8690-b92f5785d162 response_code = 200 uri = /inventory
27962024-11-19T19:50:58.926ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5d346fc3-b1ff-469c-a353-925addba06e4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27972024-11-19T19:50:58.926ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_5d346fc3-b1ff-469c-a353-925addba06e4
27982024-11-19T19:50:58.953ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3cdbf8c9-3584-411d-8acb-3e587708315a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27992024-11-19T19:50:58.953ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3cdbf8c9-3584-411d-8acb-3e587708315a
28002024-11-19T19:50:58.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 408002 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42002 req_id = 1e4013ca-bb67-4c01-b10b-d30cf8f8104f response_code = 200 uri = /inventory
28012024-11-19T19:51:08.891ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28022024-11-19T19:51:08.892ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28032024-11-19T19:51:08.901ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28042024-11-19T19:51:08.903ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28052024-11-19T19:51:16.816ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51657
28062024-11-19T19:51:16.816ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51657 req_id = f0e9ca1d-a852-40ae-bb06-be08b0c0db09 response_code = 200 uri = /baseboard
28072024-11-19T19:51:18.893ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28082024-11-19T19:51:18.893ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28092024-11-19T19:51:18.904ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28102024-11-19T19:51:18.905ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28112024-11-19T19:51:26.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36581
28122024-11-19T19:51:26.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36581 req_id = c667a649-b899-481d-a6b5-a283f7d64985 response_code = 200 uri = /vpc-routes
28132024-11-19T19:51:26.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61716
28142024-11-19T19:51:26.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61716 req_id = f1e6a7aa-1848-484b-b249-804958975e26 response_code = 200 uri = /v2p
28152024-11-19T19:51:26.932ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
28162024-11-19T19:51:26.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36581 req_id = c5c15986-059f-4b9e-9040-1f44b1546e65 response_code = 204 uri = /eip-gateways
28172024-11-19T19:51:26.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36581 req_id = 5d58db51-52f8-48e9-b12f-20090ad808e7 response_code = 204 uri = /vpc-routes
28182024-11-19T19:51:27.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41858
28192024-11-19T19:51:27.027ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28202024-11-19T19:51:27.071ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28212024-11-19T19:51:27.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102992 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41858 req_id = 6e89e2a1-97ed-48b2-a2ec-589c0501a48a response_code = 204 uri = /switch-ports
28222024-11-19T19:51:27.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41858 req_id = 8683b040-5302-457f-b084-92525ee2cca0 response_code = 200 uri = /network-bootstore-config
28232024-11-19T19:51:28.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61868
28242024-11-19T19:51:28.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61868 req_id = 220b67e2-4de5-46a1-a05e-cbf6b9c274cc response_code = 200 uri = /vpc-routes
28252024-11-19T19:51:28.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35846
28262024-11-19T19:51:28.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35846 req_id = 2b1f3545-5637-4e7c-b617-cf27bff9341e response_code = 200 uri = /v2p
28272024-11-19T19:51:28.078ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
28282024-11-19T19:51:28.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61868 req_id = 21fa36cc-749f-4f57-ba3a-b6c959d2509f response_code = 204 uri = /eip-gateways
28292024-11-19T19:51:28.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61868 req_id = 49ee7207-6685-4fdb-9f27-ad42b6237775 response_code = 204 uri = /vpc-routes
28302024-11-19T19:51:28.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37129
28312024-11-19T19:51:28.167ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28322024-11-19T19:51:28.206ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28332024-11-19T19:51:28.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95881 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37129 req_id = 99efdd45-60b3-4aa5-b302-564ea2ef9e54 response_code = 204 uri = /switch-ports
28342024-11-19T19:51:28.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34861
28352024-11-19T19:51:28.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37962
28362024-11-19T19:51:28.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37129 req_id = 08437271-21ab-4a5a-ba23-3af5b1a48a6b response_code = 200 uri = /network-bootstore-config
28372024-11-19T19:51:28.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34861 req_id = 7b8b1397-bf32-46af-bf80-0663a998a6ad response_code = 200 uri = /vpc-routes
28382024-11-19T19:51:28.263ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28392024-11-19T19:51:28.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39194
28402024-11-19T19:51:28.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2836 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39194 req_id = 76e2b693-86dd-424e-96d6-61fe1e1d03e9 response_code = 200 uri = /v2p
28412024-11-19T19:51:28.310ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28422024-11-19T19:51:28.315ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
28432024-11-19T19:51:28.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 707 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34861 req_id = baa32e4e-1b38-4e7e-ab3c-eaf38882fdb4 response_code = 204 uri = /eip-gateways
28442024-11-19T19:51:28.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34861 req_id = 34c04a6e-4dfd-4ef0-b340-9e586a567744 response_code = 204 uri = /vpc-routes
28452024-11-19T19:51:28.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111872 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37962 req_id = b2689ac5-0e82-427f-93cd-4dd85e0f868f response_code = 204 uri = /switch-ports
28462024-11-19T19:51:28.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37962 req_id = 130dd05e-6638-4af7-a0ed-20cc335e6395 response_code = 200 uri = /network-bootstore-config
28472024-11-19T19:51:28.895ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28482024-11-19T19:51:28.896ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28492024-11-19T19:51:28.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28502024-11-19T19:51:28.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28512024-11-19T19:51:38.897ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28522024-11-19T19:51:38.898ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28532024-11-19T19:51:38.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28542024-11-19T19:51:38.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28552024-11-19T19:51:46.854ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52893
28562024-11-19T19:51:46.854ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52893 req_id = 7e2a6e95-969c-4ab7-8cd9-cd3ea91b9b33 response_code = 200 uri = /baseboard
28572024-11-19T19:51:48.899ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28582024-11-19T19:51:48.899ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28592024-11-19T19:51:48.910ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28602024-11-19T19:51:48.911ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28612024-11-19T19:51:55.022ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
28622024-11-19T19:51:57.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63300
28632024-11-19T19:51:57.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63300 req_id = 5a263bce-be77-4864-adab-44f899ffae49 response_code = 200 uri = /vpc-routes
28642024-11-19T19:51:57.232ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
28652024-11-19T19:51:57.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63300 req_id = dd0280d1-6a2b-41ac-9c93-48de99a65d57 response_code = 204 uri = /eip-gateways
28662024-11-19T19:51:57.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39471
28672024-11-19T19:51:57.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39471 req_id = 11e7e010-5511-4e74-ace8-b27236cb2338 response_code = 200 uri = /v2p
28682024-11-19T19:51:57.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63300 req_id = ae4d99c7-5135-4718-8f3c-c4b883250c1b response_code = 204 uri = /vpc-routes
28692024-11-19T19:51:57.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39470
28702024-11-19T19:51:57.321ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28712024-11-19T19:51:57.382ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28722024-11-19T19:51:57.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137941 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39470 req_id = 3c178f0f-559c-46bb-aafd-46aaf4b7beb3 response_code = 204 uri = /switch-ports
28732024-11-19T19:51:57.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39470 req_id = d2bfaa6b-2572-4a62-bd30-734b39aab1ad response_code = 200 uri = /network-bootstore-config
28742024-11-19T19:51:58.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54047
28752024-11-19T19:51:58.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54047 req_id = d44515d6-253b-4089-a978-8f13e1298ee6 response_code = 200 uri = /vpc-routes
28762024-11-19T19:51:58.154ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
28772024-11-19T19:51:58.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54047 req_id = 895bab59-7633-4734-8b9a-241ef52b3d20 response_code = 204 uri = /eip-gateways
28782024-11-19T19:51:58.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54047 req_id = 8ee9e0e1-26e3-447c-b577-24aef4d04041 response_code = 204 uri = /vpc-routes
28792024-11-19T19:51:58.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49946
28802024-11-19T19:51:58.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49946 req_id = 3aec23d6-98d7-431a-a145-0fdfb7919a84 response_code = 200 uri = /vpc-routes
28812024-11-19T19:51:58.399ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
28822024-11-19T19:51:58.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49946 req_id = 32e2592e-9ca8-4769-93fc-ea7859388a5f response_code = 204 uri = /eip-gateways
28832024-11-19T19:51:58.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46789
28842024-11-19T19:51:58.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46789 req_id = a2417688-3d9e-4054-be30-d94125cba76c response_code = 200 uri = /v2p
28852024-11-19T19:51:58.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49229
28862024-11-19T19:51:58.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49229 req_id = 461af00c-a0f5-49a5-9f10-c4201b6523e3 response_code = 200 uri = /v2p
28872024-11-19T19:51:58.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49946 req_id = 920bbadb-f96f-4cab-b6e1-22326903c833 response_code = 204 uri = /vpc-routes
28882024-11-19T19:51:58.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42960
28892024-11-19T19:51:58.453ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28902024-11-19T19:51:58.497ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28912024-11-19T19:51:58.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105655 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42960 req_id = 29b5a7a6-1e99-4476-9493-ba071edc90dd response_code = 204 uri = /switch-ports
28922024-11-19T19:51:58.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55947
28932024-11-19T19:51:58.559ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28942024-11-19T19:51:58.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42960 req_id = 9e534416-6867-4122-8e8e-9f88976b7e0b response_code = 200 uri = /network-bootstore-config
28952024-11-19T19:51:58.598ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28962024-11-19T19:51:58.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103906 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55947 req_id = 95ed13a4-2981-4392-8bc1-af00e631597a response_code = 204 uri = /switch-ports
28972024-11-19T19:51:58.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55947 req_id = 683df7d7-d690-422f-855f-a4f9f2d77214 response_code = 200 uri = /network-bootstore-config
28982024-11-19T19:51:58.901ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
28992024-11-19T19:51:58.902ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29002024-11-19T19:51:58.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29012024-11-19T19:51:58.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29022024-11-19T19:52:08.903ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29032024-11-19T19:52:08.904ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29042024-11-19T19:52:08.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29052024-11-19T19:52:08.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29062024-11-19T19:52:16.887ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56434
29072024-11-19T19:52:16.888ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56434 req_id = f49bd452-2ef6-43b7-9aad-7b7dbbc84561 response_code = 200 uri = /baseboard
29082024-11-19T19:52:18.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29092024-11-19T19:52:18.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29102024-11-19T19:52:18.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29112024-11-19T19:52:18.916ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29122024-11-19T19:52:26.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60720
29132024-11-19T19:52:26.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60720 req_id = aae55057-793b-4fea-b3e9-05a22ed61eb5 response_code = 200 uri = /vpc-routes
29142024-11-19T19:52:26.996ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
29152024-11-19T19:52:26.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60720 req_id = f24dcaad-d28d-4143-a1bd-a612c4ef64ac response_code = 204 uri = /eip-gateways
29162024-11-19T19:52:27.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60720 req_id = be20bb9b-c20a-44ab-89cb-923c3ed120c1 response_code = 204 uri = /vpc-routes
29172024-11-19T19:52:27.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47109
29182024-11-19T19:52:27.071ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29192024-11-19T19:52:27.114ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29202024-11-19T19:52:27.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103277 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47109 req_id = 21dc5bc1-3020-4ac8-8c33-8e322305a505 response_code = 204 uri = /switch-ports
29212024-11-19T19:52:27.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49220
29222024-11-19T19:52:27.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47109 req_id = 3fbcdd1a-ec2c-4a94-8f93-5ae6d25ad2be response_code = 200 uri = /network-bootstore-config
29232024-11-19T19:52:27.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49220 req_id = 78cf63ad-9e0c-405a-8c80-51990c4e694c response_code = 200 uri = /v2p
29242024-11-19T19:52:27.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58984
29252024-11-19T19:52:27.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58984 req_id = d458baef-bfc0-45ad-adc1-191b60ab476d response_code = 200 uri = /vpc-routes
29262024-11-19T19:52:27.937ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
29272024-11-19T19:52:27.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58984 req_id = 1f25ff32-1f50-4e9d-a0af-90a89131412d response_code = 204 uri = /eip-gateways
29282024-11-19T19:52:27.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58984 req_id = 4351ab70-4baa-48d7-9e8c-8e6880803bb1 response_code = 204 uri = /vpc-routes
29292024-11-19T19:52:28.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41625
29302024-11-19T19:52:28.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41625 req_id = a81f51c6-ff7e-4454-a85f-65724bb70d19 response_code = 200 uri = /v2p
29312024-11-19T19:52:28.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43868
29322024-11-19T19:52:28.104ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29332024-11-19T19:52:28.149ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29342024-11-19T19:52:28.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111877 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43868 req_id = 6c819823-00df-410c-b1cb-cd8f164eeaf1 response_code = 204 uri = /switch-ports
29352024-11-19T19:52:28.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52283
29362024-11-19T19:52:28.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52283 req_id = 05c22b48-07b3-45ba-bc42-5cb221dd8970 response_code = 200 uri = /vpc-routes
29372024-11-19T19:52:28.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43868 req_id = ae0ddf66-ddb8-4500-a1e2-00b4884d7fbd response_code = 200 uri = /network-bootstore-config
29382024-11-19T19:52:28.258ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
29392024-11-19T19:52:28.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52283 req_id = c6b9bfee-b0f6-426e-be67-4f8b17ab9040 response_code = 204 uri = /eip-gateways
29402024-11-19T19:52:28.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52283 req_id = 6cfb58de-33e0-4233-baa9-e8425cfdfc3a response_code = 204 uri = /vpc-routes
29412024-11-19T19:52:28.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33210
29422024-11-19T19:52:28.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33210 req_id = 3aea27ca-875b-436f-89bf-ee3e11996b2f response_code = 200 uri = /v2p
29432024-11-19T19:52:28.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36175
29442024-11-19T19:52:28.337ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29452024-11-19T19:52:28.378ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29462024-11-19T19:52:28.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99823 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36175 req_id = ed02ff77-1a87-48bb-b9b8-e41756424597 response_code = 204 uri = /switch-ports
29472024-11-19T19:52:28.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36175 req_id = 473a02e6-ef9f-49c9-a258-f6a363504169 response_code = 200 uri = /network-bootstore-config
29482024-11-19T19:52:28.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29492024-11-19T19:52:28.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29502024-11-19T19:52:28.917ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29512024-11-19T19:52:28.918ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29522024-11-19T19:52:38.911ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29532024-11-19T19:52:38.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29542024-11-19T19:52:38.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29552024-11-19T19:52:38.920ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29562024-11-19T19:52:45.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64678
29572024-11-19T19:52:45.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64678 req_id = 83169589-58b5-4aed-b119-d0e3397681ca response_code = 200 uri = /v2p
29582024-11-19T19:52:45.491ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(1044580) }
29592024-11-19T19:52:45.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64678 req_id = c4277296-d3e8-43eb-b86e-0f4a184eb6cb response_code = 204 uri = /v2p
29602024-11-19T19:52:45.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60208
29612024-11-19T19:52:45.678ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 532005a0-7958-4028-b3e3-77fcd9d47940, kind: Instance { id: c1656de4-4bd9-4fa0-a812-f3b5257463f6 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1044580), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 532005a0-7958-4028-b3e3-77fcd9d47940, kind: Instance { id: c1656de4-4bd9-4fa0-a812-f3b5257463f6 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1044580), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 532005a0-7958-4028-b3e3-77fcd9d47940, kind: Instance { id: c1656de4-4bd9-4fa0-a812-f3b5257463f6 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1044580), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(1044580))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 532005a0-7958-4028-b3e3-77fcd9d47940, kind: Instance { id: c1656de4-4bd9-4fa0-a812-f3b5257463f6 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1044580), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-3726bb15651", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: e2dde830-4e51-46a9-a8c5-20b0da4b30b1, read_only_parent: Some(Volume { block_size: 512, id: 3bc4a132-f400-4e7f-9448-824be3cc2bd5, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 35ab7c01-0f3f-45b3-9d3b-2950308a27f6, key: Some("SetVp8/fEk8ccVtjAZMr1cduHJcCek2k6HCzmnVpM9o="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::16]:19002", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: e2dde830-4e51-46a9-a8c5-20b0da4b30b1, key: Some("uB67tESve/eU4AVPPmBa5VtRWNEPxpUiYQWQywrigOU="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19003", "[fd00:1122:3344:101::13]:19000", "[fd00:1122:3344:101::12]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-3726bb15651" }] }), cloud_init_bytes: Some(..) } instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 metadata = InstanceMetadata { silo_id: 574d9db1-c33c-4483-8f91-17356849e552, project_id: 27e61f97-585f-4aff-9681-21074eb7e97c } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-19T19:52:45.671711202Z }
29622024-11-19T19:52:45.678ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 migration_id = None propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
29632024-11-19T19:52:45.678ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 migration_id = None propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 532005a0-7958-4028-b3e3-77fcd9d47940, kind: Instance { id: c1656de4-4bd9-4fa0-a812-f3b5257463f6 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1044580), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 532005a0-7958-4028-b3e3-77fcd9d47940, kind: Instance { id: c1656de4-4bd9-4fa0-a812-f3b5257463f6 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1044580), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 532005a0-7958-4028-b3e3-77fcd9d47940, kind: Instance { id: c1656de4-4bd9-4fa0-a812-f3b5257463f6 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1044580), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(1044580))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 532005a0-7958-4028-b3e3-77fcd9d47940, kind: Instance { id: c1656de4-4bd9-4fa0-a812-f3b5257463f6 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1044580), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-3726bb15651", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: e2dde830-4e51-46a9-a8c5-20b0da4b30b1, read_only_parent: Some(Volume { block_size: 512, id: 3bc4a132-f400-4e7f-9448-824be3cc2bd5, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 35ab7c01-0f3f-45b3-9d3b-2950308a27f6, key: Some("SetVp8/fEk8ccVtjAZMr1cduHJcCek2k6HCzmnVpM9o="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::16]:19002", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: e2dde830-4e51-46a9-a8c5-20b0da4b30b1, key: Some("uB67tESve/eU4AVPPmBa5VtRWNEPxpUiYQWQywrigOU="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19003", "[fd00:1122:3344:101::13]:19000", "[fd00:1122:3344:101::12]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-3726bb15651" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-19T19:52:45.671711202Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29642024-11-19T19:52:45.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6997 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60208 req_id = 46828781-80f6-4116-8f86-eb1c8418b5c4 response_code = 200 uri = /vmms/ce4647e9-0216-44c5-b36b-bb792068dc47
29652024-11-19T19:52:45.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65272
29662024-11-19T19:52:45.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 431 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65272 req_id = e7fcf640-b676-46be-998c-b55661afedac response_code = 200 uri = /vmms/ce4647e9-0216-44c5-b36b-bb792068dc47/state
29672024-11-19T19:52:45.790ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 1044580 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29682024-11-19T19:52:45.790ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29692024-11-19T19:52:45.843ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47 file = illumos-utils/src/zone.rs:325 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
29702024-11-19T19:52:45.867ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47 file = illumos-utils/src/zone.rs:363 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
29712024-11-19T19:52:45.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60895
29722024-11-19T19:52:45.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60895 req_id = a5e81d84-b5e5-45a2-b77c-40959cce3c5f response_code = 200 uri = /vpc-routes
29732024-11-19T19:52:45.927ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {532005a0-7958-4028-b3e3-77fcd9d47940: {10.151.1.175: {97e1f22a-3068-4271-bde0-82d7822888b7}, 10.151.1.176: {97e1f22a-3068-4271-bde0-82d7822888b7}}} }
29742024-11-19T19:52:46.925ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53034
29752024-11-19T19:52:46.925ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53034 req_id = 03c3e367-a0eb-4df6-b3ac-4b5638050627 response_code = 200 uri = /baseboard
29762024-11-19T19:52:47.347ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
29772024-11-19T19:52:47.347ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47 zone file = illumos-utils/src/running_zone.rs:488 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 zone = oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47
29782024-11-19T19:52:47.538ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47") failed: Property not found. retry in 74.947523ms file = illumos-utils/src/svc.rs:36 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 zone = oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47
29792024-11-19T19:52:47.632ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47") failed: Property not found. retry in 113.795659ms file = illumos-utils/src/svc.rs:36 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 zone = oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47
29802024-11-19T19:52:47.769ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47") failed: Property not found. retry in 107.269861ms file = illumos-utils/src/svc.rs:36 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 zone = oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47
29812024-11-19T19:52:47.890ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47") failed: Property not found. retry in 264.685231ms file = illumos-utils/src/svc.rs:36 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 zone = oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47
29822024-11-19T19:52:48.174ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47") failed: Property not found. retry in 1.017483413s file = illumos-utils/src/svc.rs:36 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 zone = oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47
29832024-11-19T19:52:48.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29842024-11-19T19:52:48.916ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29852024-11-19T19:52:48.933ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29862024-11-19T19:52:48.935ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29872024-11-19T19:52:49.213ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47") failed: Property not found. retry in 1.189514553s file = illumos-utils/src/svc.rs:36 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 zone = oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47
29882024-11-19T19:52:50.416ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47") failed: Property not found. retry in 1.194348199s file = illumos-utils/src/svc.rs:36 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 zone = oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47
29892024-11-19T19:52:51.625ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47") failed: Property not found. retry in 557.267071ms file = illumos-utils/src/svc.rs:36 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 zone = oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47
29902024-11-19T19:52:52.196ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47") failed: Property not found. retry in 868.110801ms file = illumos-utils/src/svc.rs:36 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 zone = oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47
29912024-11-19T19:52:53.096ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47 file = sled-agent/src/instance.rs:1787 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
29922024-11-19T19:52:53.107ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47") failed: Property not found. retry in 45.192991ms file = illumos-utils/src/svc.rs:36 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
29932024-11-19T19:52:53.162ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47") failed: Property not found. retry in 98.617923ms file = illumos-utils/src/svc.rs:36 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
29942024-11-19T19:52:53.272ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
29952024-11-19T19:52:53.308ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
29962024-11-19T19:52:53.448ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
29972024-11-19T19:52:53.449ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1212 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
29982024-11-19T19:52:53.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7522578 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60895 req_id = a0b47a24-b6bd-4403-bc07-d8c96aac77df response_code = 204 uri = /eip-gateways
29992024-11-19T19:52:53.450ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-19T19:52:53.450239278Z } file = sled-agent/src/instance.rs:780 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
30002024-11-19T19:52:53.450ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-19T19:52:53.450239278Z } propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
30012024-11-19T19:52:53.450ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-19T19:52:53.450239278Z }, migration_in: None, migration_out: None }
30022024-11-19T19:52:53.469ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-19T19:52:53.469166781Z } file = sled-agent/src/instance.rs:780 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
30032024-11-19T19:52:53.469ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-19T19:52:53.469166781Z } propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
30042024-11-19T19:52:53.469ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-19T19:52:53.469166781Z }, migration_in: None, migration_out: None }
30052024-11-19T19:52:53.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 360 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60895 req_id = 749db1b8-0591-4f45-8195-60302dfc88ac response_code = 204 uri = /vpc-routes
30062024-11-19T19:52:56.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59125
30072024-11-19T19:52:56.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59125 req_id = deeae1da-c158-4cbb-b7d9-8eeee1cd2a06 response_code = 200 uri = /vmms/ce4647e9-0216-44c5-b36b-bb792068dc47/state
30082024-11-19T19:52:57.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51881
30092024-11-19T19:52:57.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51881 req_id = dc0a22c1-8842-49d4-99cf-f59c46141dfe response_code = 200 uri = /vpc-routes
30102024-11-19T19:52:57.106ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {532005a0-7958-4028-b3e3-77fcd9d47940: {10.151.1.176: {97e1f22a-3068-4271-bde0-82d7822888b7}, 10.151.1.175: {97e1f22a-3068-4271-bde0-82d7822888b7}}} }
30112024-11-19T19:52:57.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51881 req_id = 349278fc-94c5-4d14-9c25-29a6a6c0ac1d response_code = 204 uri = /eip-gateways
30122024-11-19T19:52:57.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51881 req_id = 695e08c8-7e22-4e85-ba62-dddbb02f5611 response_code = 204 uri = /vpc-routes
30132024-11-19T19:52:57.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55489
30142024-11-19T19:52:57.252ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
30152024-11-19T19:52:57.297ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
30162024-11-19T19:52:57.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106472 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55489 req_id = 8458e64a-eca3-444f-8632-62a58f313490 response_code = 204 uri = /switch-ports
30172024-11-19T19:52:57.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55701
30182024-11-19T19:52:57.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55489 req_id = 1e7ecb2d-ee3d-491c-bbea-10619e2744c4 response_code = 200 uri = /network-bootstore-config
30192024-11-19T19:52:57.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55701 req_id = 7e041d3c-fa19-46d2-8ea7-c488d93add8f response_code = 200 uri = /v2p
30202024-11-19T19:52:58.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44887
30212024-11-19T19:52:58.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44887 req_id = 71a9acec-26a6-439d-b0eb-d91df36db22b response_code = 200 uri = /vpc-routes
30222024-11-19T19:52:58.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46618
30232024-11-19T19:52:58.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46618 req_id = 5186fe43-6c03-43ac-8e12-b6dc5d5b677b response_code = 200 uri = /v2p
30242024-11-19T19:52:58.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46741
30252024-11-19T19:52:58.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46741 req_id = 40296ae7-eec7-4a4f-930a-6cfdd05499d6 response_code = 200 uri = /vmms/ce4647e9-0216-44c5-b36b-bb792068dc47/state
30262024-11-19T19:52:58.226ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {532005a0-7958-4028-b3e3-77fcd9d47940: {10.151.1.176: {97e1f22a-3068-4271-bde0-82d7822888b7}, 10.151.1.175: {97e1f22a-3068-4271-bde0-82d7822888b7}}} }
30272024-11-19T19:52:58.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44887 req_id = 214b89fa-2a16-4d19-ad8f-8fd71cfff9b0 response_code = 204 uri = /eip-gateways
30282024-11-19T19:52:58.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44887 req_id = bc9c97e2-5dd0-43fa-a067-359f76dcee3c response_code = 204 uri = /vpc-routes
30292024-11-19T19:52:58.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36082
30302024-11-19T19:52:58.294ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
30312024-11-19T19:52:58.350ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
30322024-11-19T19:52:58.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139323 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36082 req_id = f30c6775-074d-421c-b549-4b3df3d932c1 response_code = 204 uri = /switch-ports
30332024-11-19T19:52:58.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47436
30342024-11-19T19:52:58.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58325
30352024-11-19T19:52:58.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36082 req_id = 86a4f9ce-9457-4c66-9415-0deb59b36684 response_code = 200 uri = /network-bootstore-config
30362024-11-19T19:52:58.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47436 req_id = 1f7e9337-d4d0-498a-aa9c-103d39426960 response_code = 200 uri = /vpc-routes
30372024-11-19T19:52:58.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58325 req_id = f3bd8787-35f2-43b4-ac7b-dc43a144cb20 response_code = 200 uri = /vmms/ce4647e9-0216-44c5-b36b-bb792068dc47/state
30382024-11-19T19:52:58.485ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {532005a0-7958-4028-b3e3-77fcd9d47940: {10.151.1.176: {97e1f22a-3068-4271-bde0-82d7822888b7}, 10.151.1.175: {97e1f22a-3068-4271-bde0-82d7822888b7}}} }
30392024-11-19T19:52:58.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47436 req_id = ffabb733-2393-4768-b391-d6940a565d37 response_code = 204 uri = /eip-gateways
30402024-11-19T19:52:58.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43817
30412024-11-19T19:52:58.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43817 req_id = 85b85bbf-e438-45fb-aec2-5052bf607a66 response_code = 200 uri = /v2p
30422024-11-19T19:52:58.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47436 req_id = 49d0c711-ac3d-4fea-a8cb-857aa52f74d1 response_code = 204 uri = /vpc-routes
30432024-11-19T19:52:58.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33003
30442024-11-19T19:52:58.550ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
30452024-11-19T19:52:58.592ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
30462024-11-19T19:52:58.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100948 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33003 req_id = c5764c13-d3ae-436d-ac30-09ea14c439cc response_code = 204 uri = /switch-ports
30472024-11-19T19:52:58.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33003 req_id = e33e83f3-d6f0-4748-ae86-dfdcf0bbe332 response_code = 200 uri = /network-bootstore-config
30482024-11-19T19:52:58.918ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
30492024-11-19T19:52:58.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
30502024-11-19T19:52:58.935ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
30512024-11-19T19:52:58.938ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
30522024-11-19T19:53:03.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40340
30532024-11-19T19:53:03.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 540 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40340 req_id = fc73f3d6-5007-48db-89c2-358ed381c9dc response_code = 200 uri = /vmms/ce4647e9-0216-44c5-b36b-bb792068dc47/state
30542024-11-19T19:53:03.348ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-19T19:53:03.348670377Z } file = sled-agent/src/instance.rs:780 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
30552024-11-19T19:53:03.348ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-19T19:53:03.348670377Z } propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
30562024-11-19T19:53:03.348ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-19T19:53:03.348670377Z }, migration_in: None, migration_out: None }
30572024-11-19T19:53:03.357ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-19T19:53:03.357336012Z } file = sled-agent/src/instance.rs:780 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
30582024-11-19T19:53:03.357ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-19T19:53:03.357336012Z } propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
30592024-11-19T19:53:03.357ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
30602024-11-19T19:53:03.357ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30612024-11-19T19:53:03.357ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 17785122106566954175 n_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
30622024-11-19T19:53:03.357ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 8569417449001767232 n_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
30632024-11-19T19:53:03.357ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30642024-11-19T19:53:03.357ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/d3dd1034-4279-4c8b-a3e7-e06018ad7ea1/debug/bundle/zone", "/pool/int/fbc1611e-058f-49c8-948e-b1a1af061463/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/a60d50c5-1d31-4171-ba2e-661c260a4561/crypt/debug", "/pool/ext/be436df4-34a1-4101-90ff-be2f8ef7e824/crypt/debug", "/pool/ext/af234a87-284a-4af4-aac4-6b58ea279f05/crypt/debug", "/pool/ext/43c663f2-b051-403e-bcad-e419348a9017/crypt/debug", "/pool/ext/f1d7fa4a-6150-4e79-a410-b71fd3b63c5c/crypt/debug", "/pool/ext/b5075ce0-4de0-43fe-a8e8-40bff047022b/crypt/debug", "/pool/ext/fa881b81-fb55-465b-a7d1-159614622ca4/crypt/debug", "/pool/ext/5d346fc3-b1ff-469c-a353-925addba06e4/crypt/debug", "/pool/ext/3cdbf8c9-3584-411d-8acb-3e587708315a/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47
30652024-11-19T19:53:04.036ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47", bundle_id: 5f9781dc-d0c2-4ce6-9719-6cb0e0bb1c6b }, time_created: 2024-11-19T19:53:03.358544314Z, version: 0, cause: TerminatedInstance }
30662024-11-19T19:53:04.036ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_ce4647e9-0216-44c5-b36b-bb792068dc47 file = sled-agent/src/instance.rs:1032 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
30672024-11-19T19:53:05.795ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
30682024-11-19T19:53:05.815ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(1044580), kind: System }
30692024-11-19T19:53:05.815ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(1044580), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30702024-11-19T19:53:05.815ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-19T19:53:05.815679211Z }, migration_in: None, migration_out: None }
30712024-11-19T19:53:05.874ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-19T19:53:05.815679211Z }, migration_in: None, migration_out: None }
30722024-11-19T19:53:05.876ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = c1656de4-4bd9-4fa0-a812-f3b5257463f6 propolis_id = ce4647e9-0216-44c5-b36b-bb792068dc47
30732024-11-19T19:53:06.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41091
30742024-11-19T19:53:06.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41091 req_id = 6000e29d-06d0-4ad2-a8c5-999189037924 response_code = 200 uri = /vpc-routes
30752024-11-19T19:53:06.472ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
30762024-11-19T19:53:06.472ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1212 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
30772024-11-19T19:53:06.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41091 req_id = 89ae6bd2-e9e1-4803-9c35-1ffd8da8c441 response_code = 204 uri = /eip-gateways
30782024-11-19T19:53:06.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41091 req_id = 7c5d1709-99f2-44d1-bb07-1b96e2bafe03 response_code = 204 uri = /vpc-routes
30792024-11-19T19:53:06.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47074
30802024-11-19T19:53:06.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47074 req_id = 2b5271d7-2002-448f-a381-b548208ff5ff response_code = 200 uri = /v2p
30812024-11-19T19:53:06.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38376
30822024-11-19T19:53:06.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38376 req_id = 6f514a8b-fdfa-42f3-8b54-41e2d1c68b12 response_code = 200 uri = /v2p
30832024-11-19T19:53:06.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33462
30842024-11-19T19:53:06.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33462 req_id = ae964f7c-fc89-4c8e-9baf-032d16e43932 response_code = 200 uri = /vpc-routes
30852024-11-19T19:53:06.827ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
30862024-11-19T19:53:06.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33462 req_id = 5578f44a-8c0f-422b-93c1-4547d7fe3b92 response_code = 204 uri = /eip-gateways
30872024-11-19T19:53:06.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33462 req_id = 06bc4ad1-c4ee-4164-af16-71741c4e206c response_code = 204 uri = /vpc-routes
30882024-11-19T19:53:07.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36575
30892024-11-19T19:53:07.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36575 req_id = d9dd0be8-b13d-4dad-b947-9af231d766d6 response_code = 200 uri = /vpc-routes
30902024-11-19T19:53:07.732ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1186 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be values = ExternalIpGatewayMap { mappings: {} }
30912024-11-19T19:53:07.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36575 req_id = a9b9e2d0-4274-4b95-9178-b3e3e726bdfa response_code = 204 uri = /eip-gateways
30922024-11-19T19:53:07.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36575 req_id = de772a1f-e769-43b9-8b11-12f8a53c4cf2 response_code = 204 uri = /vpc-routes
30932024-11-19T19:53:08.921ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
30942024-11-19T19:53:08.922ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
30952024-11-19T19:53:08.936ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be
30962024-11-19T19:53:08.940ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 367f799f-31b8-4d9a-a686-ab6e465d52be