Max level shown:
1 [ Nov 4 23:50:36 Enabled. ]
2 [ Nov 4 23:50:36 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 4 23:50:36 Method "start" exited with status 0. ]
4 [ Nov 4 23:50:36 Rereading configuration. ]
5 [ Nov 4 23:50:36 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-04T23:50:36.686ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-04T23:50:36.686ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-04T23:50:36.740ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-04T23:50:36.740ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-04T23:50:36.853ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-04T23:50:36.862ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-04T23:50:36.870ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-04T23:50:37.473ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-11-04T23:50:37.610ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-04T23:50:37.610ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-04T23:50:37.611ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-04T23:50:37.611ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-04T23:50:37.611ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-04T23:50:37.611ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-04T23:50:37.614ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-04T23:50:37.614ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-04T23:50:37.614ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-04T23:50:37.614ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-04T23:50:37.614ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-04T23:50:37.614ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-04T23:50:37.614ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
282024-11-04T23:50:37.614ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-04T23:50:37.614ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-04T23:50:37.625ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-04T23:50:37.625ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 6e4a40d2-b3cd-4961-8098-a9d57834f0b0 (zpool)
322024-11-04T23:50:37.727ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 6e4a40d2-b3cd-4961-8098-a9d57834f0b0 (zpool), kind: Internal }
332024-11-04T23:50:38.200ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
342024-11-04T23:50:38.200ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-04T23:50:38.200ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-04T23:50:38.200ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-04T23:50:38.200ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
382024-11-04T23:50:38.200ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-04T23:50:38.200ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-04T23:50:38.209ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-04T23:50:38.209ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = fde07b41-a029-4be1-85a1-4d19a7248f1f (zpool)
422024-11-04T23:50:38.296ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: fde07b41-a029-4be1-85a1-4d19a7248f1f (zpool), kind: Internal }
432024-11-04T23:50:38.787ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-04T23:50:38.787ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6e4a40d2-b3cd-4961-8098-a9d57834f0b0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fde07b41-a029-4be1-85a1-4d19a7248f1f (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-04T23:50:38.787ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-04T23:50:38.787ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
472024-11-04T23:50:38.787ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
482024-11-04T23:50:38.787ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
492024-11-04T23:50:38.787ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-04T23:50:38.787ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
512024-11-04T23:50:38.787ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6e4a40d2-b3cd-4961-8098-a9d57834f0b0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fde07b41-a029-4be1-85a1-4d19a7248f1f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
522024-11-04T23:50:38.787ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
532024-11-04T23:50:38.787ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542024-11-04T23:50:38.787ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-11-04T23:50:38.787ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-04T23:50:38.787ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
572024-11-04T23:50:38.787ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
582024-11-04T23:50:38.787ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6e4a40d2-b3cd-4961-8098-a9d57834f0b0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fde07b41-a029-4be1-85a1-4d19a7248f1f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
592024-11-04T23:50:38.787ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-11-04T23:50:38.787ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-11-04T23:50:38.787ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-04T23:50:38.787ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6e4a40d2-b3cd-4961-8098-a9d57834f0b0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fde07b41-a029-4be1-85a1-4d19a7248f1f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-11-04T23:50:38.787ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-11-04T23:50:38.787ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652024-11-04T23:50:38.787ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
662024-11-04T23:50:38.787ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-11-04T23:50:38.787ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-04T23:50:38.787ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6e4a40d2-b3cd-4961-8098-a9d57834f0b0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fde07b41-a029-4be1-85a1-4d19a7248f1f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-04T23:50:38.787ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-04T23:50:38.787ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-04T23:50:38.787ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
722024-11-04T23:50:38.787ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-04T23:50:38.787ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-04T23:50:38.787ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
752024-11-04T23:50:38.787ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
762024-11-04T23:50:38.787ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
772024-11-04T23:50:38.787ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6e4a40d2-b3cd-4961-8098-a9d57834f0b0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fde07b41-a029-4be1-85a1-4d19a7248f1f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
782024-11-04T23:50:38.788ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
792024-11-04T23:50:38.788ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
802024-11-04T23:50:38.788ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
812024-11-04T23:50:38.788ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-11-04T23:50:38.788ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
832024-11-04T23:50:38.788ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
842024-11-04T23:50:38.788ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6e4a40d2-b3cd-4961-8098-a9d57834f0b0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fde07b41-a029-4be1-85a1-4d19a7248f1f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
852024-11-04T23:50:38.788ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
862024-11-04T23:50:38.788ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
872024-11-04T23:50:38.788ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
882024-11-04T23:50:38.788ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
892024-11-04T23:50:38.788ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
902024-11-04T23:50:38.788ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6e4a40d2-b3cd-4961-8098-a9d57834f0b0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fde07b41-a029-4be1-85a1-4d19a7248f1f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
912024-11-04T23:50:38.788ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
922024-11-04T23:50:38.788ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
932024-11-04T23:50:38.788ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
942024-11-04T23:50:38.788ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
952024-11-04T23:50:38.788ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6e4a40d2-b3cd-4961-8098-a9d57834f0b0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fde07b41-a029-4be1-85a1-4d19a7248f1f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
962024-11-04T23:50:38.788ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
972024-11-04T23:50:38.788ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
982024-11-04T23:50:38.788ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-04T23:50:38.788ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1002024-11-04T23:50:38.788ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6e4a40d2-b3cd-4961-8098-a9d57834f0b0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fde07b41-a029-4be1-85a1-4d19a7248f1f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012024-11-04T23:50:38.788ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-11-04T23:50:38.788ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032024-11-04T23:50:38.788ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-04T23:50:38.788ZINFOSledAgent (bootstore): No ledger in /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-11-04T23:50:38.788ZINFOSledAgent (bootstore): No ledger in /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-11-04T23:50:38.788ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-11-04T23:50:38.788ZINFOSledAgent (bootstore): No ledger in /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-11-04T23:50:38.788ZINFOSledAgent (bootstore): No ledger in /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-11-04T23:50:38.788ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-11-04T23:50:38.788ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-04T23:50:38.788ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-04T23:50:38.799ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:733
1132024-11-04T23:50:38.799ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2682, tv_nsec: 672465545 } time_to_next_cleanup = 599.999932618s
1142024-11-04T23:50:38.799ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3909
1152024-11-04T23:50:38.799ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1162024-11-04T23:50:38.802ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-04T23:50:38.802ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-04T23:50:38.802ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-11-04T23:50:38.804ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-11-04T23:50:38.804ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1083
1212024-11-04T23:50:38.804ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-04T23:50:38.805ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1232024-11-04T23:50:38.805ZINFOSledAgent (RSS): No ledger in /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-04T23:50:38.805ZINFOSledAgent (RSS): No ledger in /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-04T23:50:38.805ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1146
1262024-11-04T23:50:38.805ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1272024-11-04T23:50:38.805ZINFOSledAgent (RSS): No ledger in /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-04T23:50:38.805ZINFOSledAgent (RSS): No ledger in /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-04T23:50:38.805ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1188
1302024-11-04T23:50:38.805ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-04T23:50:38.805ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-04T23:50:38.805ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1332024-11-04T23:50:38.805ZINFOSledAgent (RSS): Writing ledger to /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-04T23:50:38.805ZINFOSledAgent (RSS): Writing ledger to /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-04T23:50:38.805ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 (sled), rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-04T23:50:38.805ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1222
1372024-11-04T23:50:38.805ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382024-11-04T23:50:38.805ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1392024-11-04T23:50:38.805ZINFOSledAgent (bootstore): Writing ledger to /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-11-04T23:50:38.806ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412024-11-04T23:50:38.806ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 (sled), rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422024-11-04T23:50:38.807ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4206
1432024-11-04T23:50:38.807ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4588
1442024-11-04T23:50:38.811ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-04T23:50:38.817ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-04T23:50:38.817ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-04T23:50:38.821ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-04T23:50:38.821ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-04T23:50:38.821ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:58051
1502024-11-04T23:50:38.822ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 (sled), rack_id: 8c1d2eb7-1489-42d7-9ade-7cb4bea90783, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-04T23:50:38.822ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-04T23:50:38.822ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-04T23:50:38.822ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:451
1542024-11-04T23:50:38.822ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:644
1552024-11-04T23:50:38.822ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1562024-11-04T23:50:38.822ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1572024-11-04T23:50:38.822ZINFOSledAgent (StorageManager): No ledger in /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-11-04T23:50:38.822ZINFOSledAgent (StorageManager): No ledger in /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-11-04T23:50:38.822ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:633
1602024-11-04T23:50:38.822ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:661
1612024-11-04T23:50:38.822ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:440
1622024-11-04T23:50:38.822ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-04T23:50:38.822ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:532 result = DisksManagementResult { status: [] }
1642024-11-04T23:50:38.837ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1652024-11-04T23:50:38.858ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-04T23:50:38.876ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-04T23:50:38.881ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
1682024-11-04T23:50:38.881ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1692024-11-04T23:50:38.881ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
1702024-11-04T23:50:38.882ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-04T23:50:38.884ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 50.884687ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "57c76e64-a7c2-4d35-86d8-6fcce9c2e625", "content-length": "124", "date": "Mon, 04 Nov 2024 23:50:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "57c76e64-a7c2-4d35-86d8-6fcce9c2e625" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-04T23:50:38.895ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_6e4a40d2-b3cd-4961-8098-a9d57834f0b0/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-04T23:50:38.917ZINFOSledAgent: successfully created encrypted zvol: name="oxi_6e4a40d2-b3cd-4961-8098-a9d57834f0b0/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-04T23:50:38.917ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_6e4a40d2-b3cd-4961-8098-a9d57834f0b0/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-04T23:50:38.922ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
1762024-11-04T23:50:38.922ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-04T23:50:38.922ZINFOSledAgent (BackingFs): Ensuring dataset oxi_6e4a40d2-b3cd-4961-8098-a9d57834f0b0/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-04T23:50:38.936ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-11-04T23:50:38.936ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 156.750161ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "02f05763-d660-4c8d-8705-edcb3ec8dccb", "content-length": "124", "date": "Mon, 04 Nov 2024 23:50:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "02f05763-d660-4c8d-8705-edcb3ec8dccb" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-11-04T23:50:39.010ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1812024-11-04T23:50:39.094ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-04T23:50:39.095ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 116.028287ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b2c2d372-ae35-45ec-91ac-d71688064bca", "content-length": "124", "date": "Mon, 04 Nov 2024 23:50:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b2c2d372-ae35-45ec-91ac-d71688064bca" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-04T23:50:39.212ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1842024-11-04T23:50:39.213ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 248.063055ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d043f606-dc6f-43fa-98e2-fb63491b122b", "content-length": "124", "date": "Mon, 04 Nov 2024 23:50:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d043f606-dc6f-43fa-98e2-fb63491b122b" } file = clients/ddm-admin-client/src/lib.rs:177
1852024-11-04T23:50:39.229ZINFOSledAgent (BackingFs): Mounting oxi_6e4a40d2-b3cd-4961-8098-a9d57834f0b0/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1862024-11-04T23:50:39.243ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1872024-11-04T23:50:39.243ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1882024-11-04T23:50:39.243ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1892024-11-04T23:50:39.243ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1902024-11-04T23:50:39.462ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-04T23:50:39.463ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 288.9381ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "28bdaba4-c2d9-41a8-b9b3-9acb341fbd71", "content-length": "124", "date": "Mon, 04 Nov 2024 23:50:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "28bdaba4-c2d9-41a8-b9b3-9acb341fbd71" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-04T23:50:39.753ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-04T23:50:39.754ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 130.656001ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "50d77acd-018b-4ba1-9677-8bcab89ad6e7", "content-length": "124", "date": "Mon, 04 Nov 2024 23:50:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "50d77acd-018b-4ba1-9677-8bcab89ad6e7" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-04T23:50:39.886ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-04T23:50:39.886ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 233.628146ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e1f80cbe-2ae6-4453-9ba9-8d620490c852", "content-length": "124", "date": "Mon, 04 Nov 2024 23:50:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e1f80cbe-2ae6-4453-9ba9-8d620490c852" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-04T23:50:39.963ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
1972024-11-04T23:50:39.968ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:41419 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
1982024-11-04T23:50:39.968ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
1992024-11-04T23:50:39.968ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:41419 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2002024-11-04T23:50:39.969ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 369.005322ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2012024-11-04T23:50:39.970ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2022024-11-04T23:50:39.970ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2032024-11-04T23:50:39.970ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:917 underlay_address = fd00:1122:3344:101::1
2042024-11-04T23:50:39.970ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2052024-11-04T23:50:40.121ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2062024-11-04T23:50:40.339ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 601.644128ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2072024-11-04T23:50:40.942ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 868.27386ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2082024-11-04T23:50:41.812ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.500663669s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2092024-11-04T23:50:42.496ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2664
2102024-11-04T23:50:42.496ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2882
2112024-11-04T23:50:42.496ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2534
2122024-11-04T23:50:42.496ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2581
2132024-11-04T23:50:42.496ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2963
2142024-11-04T23:50:42.496ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3005
2152024-11-04T23:50:42.498ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2807
2162024-11-04T23:50:42.500ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2575
2172024-11-04T23:50:42.500ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='c720eaea-193e-42ff-b99b-da2d805b3655'/> <propval type="astring" name="rack_id" value='8c1d2eb7-1489-42d7-9ade-7cb4bea90783'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe53:bf7b'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_id" value='e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29'/> <propval type="astring" name="rack_id" value='8c1d2eb7-1489-42d7-9ade-7cb4bea90783'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29'/> <propval type="astring" name="rack_uuid" value='8c1d2eb7-1489-42d7-9ade-7cb4bea90783'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29'/> <propval type="astring" name="rack_uuid" value='8c1d2eb7-1489-42d7-9ade-7cb4bea90783'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2182024-11-04T23:50:42.500ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2192024-11-04T23:50:42.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 28.390963ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-11-04T23:50:43.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 145.284497ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-04T23:50:43.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 238.288559ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-04T23:50:43.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 291.441009ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-04T23:50:44.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 433.462052ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-04T23:50:44.315ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.579229891s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2252024-11-04T23:50:44.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 811.000382ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-04T23:50:45.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.454963533s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-04T23:50:47.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 770.729936ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-11-04T23:50:48.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 858.039381ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-04T23:50:49.327ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/nexus.rs:527 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2302024-11-04T23:50:49.356ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2312024-11-04T23:50:49.357ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2322024-11-04T23:50:49.357ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12345
2332024-11-04T23:50:49.358ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2342024-11-04T23:50:49.358ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2352024-11-04T23:50:49.358ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362024-11-04T23:50:49.358ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2372024-11-04T23:50:49.358ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2382024-11-04T23:50:49.358ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2392024-11-04T23:50:49.358ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3909
2402024-11-04T23:50:49.358ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:58051
2412024-11-04T23:50:49.551ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2422024-11-04T23:50:49.551ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2432024-11-04T23:50:49.551ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2442024-11-04T23:50:49.551ZINFOSledAgent (RSS): No ledger in /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2452024-11-04T23:50:49.551ZINFOSledAgent (RSS): No ledger in /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2462024-11-04T23:50:49.551ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2472024-11-04T23:50:49.551ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2482024-11-04T23:50:49.551ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2492024-11-04T23:50:49.551ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2502024-11-04T23:50:49.556ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4230 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2512024-11-04T23:50:49.556ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4246
2522024-11-04T23:50:49.556ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2532024-11-04T23:50:49.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45124
2542024-11-04T23:50:49.817ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2552024-11-04T23:50:49.817ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2562024-11-04T23:50:49.817ZINFOSledAgent (ServiceManager): No ledger in /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/omicron-zones.json file = common/src/ledger.rs:188
2572024-11-04T23:50:49.817ZINFOSledAgent (ServiceManager): No ledger in /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/omicron-zones.json file = common/src/ledger.rs:188
2582024-11-04T23:50:49.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 388 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45124 req_id = 08c0d748-2a61-4d71-9bae-49aa6600b813 response_code = 200 uri = /inventory
2592024-11-04T23:50:49.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62575
2602024-11-04T23:50:49.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62575 req_id = cfe01d83-1b75-4ab4-a7b6-97f7edca1fc3 response_code = 200 uri = /sled-role
2612024-11-04T23:50:49.849ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2622024-11-04T23:50:49.849ZINFOSledAgent (RSS): Writing ledger to /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2632024-11-04T23:50:49.849ZINFOSledAgent (RSS): Writing ledger to /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2642024-11-04T23:50:49.850ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:886
2652024-11-04T23:50:49.881ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 2b35731b-b552-4828-99b0-f69c24ba6dd5, pool_id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 4080cd9b-43f6-4685-a737-cc6430d03d23, pool_id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 4fa3102d-696d-454c-96ba-e3bba7c0fe13, pool_id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 92367eb2-9f4a-4973-9403-fab67c30a868, pool_id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 34b9881e-f120-47ea-b4cd-5af0c4b06fd0, pool_id: 6634f6ec-a171-4828-a984-8fb31f78439b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: a77bc147-ff0f-4cad-a834-8c1b90f9c272, pool_id: aeae1e8c-da96-4cb8-a754-49b610133fd0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 9ee9fa53-7900-48f6-83cb-852947b1d3db, pool_id: ffa9fae5-11fd-49c9-ab91-90383e170a6c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: c280a35e-13db-4d68-882a-b6fb913c09e7, pool_id: 7bc77ba6-9886-4954-bc34-bc232ce1413f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 458ca3a7-35df-48d5-a4e2-1293ac89aa44, pool_id: 7449cf8d-6d8a-4759-b257-0067c28bc087 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:376 sled_address = [fd00:1122:3344:101::1]:12345
2662024-11-04T23:50:49.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50713
2672024-11-04T23:50:49.881ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:886 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2682024-11-04T23:50:49.881ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 2b35731b-b552-4828-99b0-f69c24ba6dd5, pool_id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 4080cd9b-43f6-4685-a737-cc6430d03d23, pool_id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 4fa3102d-696d-454c-96ba-e3bba7c0fe13, pool_id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 92367eb2-9f4a-4973-9403-fab67c30a868, pool_id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 34b9881e-f120-47ea-b4cd-5af0c4b06fd0, pool_id: 6634f6ec-a171-4828-a984-8fb31f78439b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: a77bc147-ff0f-4cad-a834-8c1b90f9c272, pool_id: aeae1e8c-da96-4cb8-a754-49b610133fd0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 9ee9fa53-7900-48f6-83cb-852947b1d3db, pool_id: ffa9fae5-11fd-49c9-ab91-90383e170a6c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: c280a35e-13db-4d68-882a-b6fb913c09e7, pool_id: 7bc77ba6-9886-4954-bc34-bc232ce1413f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 458ca3a7-35df-48d5-a4e2-1293ac89aa44, pool_id: 7449cf8d-6d8a-4759-b257-0067c28bc087 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:451
2692024-11-04T23:50:49.881ZINFOSledAgent (StorageManager): No ledger in /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2702024-11-04T23:50:49.881ZINFOSledAgent (StorageManager): No ledger in /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2712024-11-04T23:50:49.881ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:866 request = omicron_physical_disks_ensure
2722024-11-04T23:50:49.881ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2732024-11-04T23:50:49.881ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2742024-11-04T23:50:49.881ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2752024-11-04T23:50:49.881ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2762024-11-04T23:50:50.024ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2772024-11-04T23:50:50.026ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.932883892s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2782024-11-04T23:50:50.027ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14601085485859320040 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2792024-11-04T23:50:50.027ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3790918871880139736 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2802024-11-04T23:50:50.032ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2812024-11-04T23:50:50.032ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool)
2822024-11-04T23:50:50.133ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }
2832024-11-04T23:50:50.142ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:225
2842024-11-04T23:50:50.142ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:227
2852024-11-04T23:50:50.142ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:231
2862024-11-04T23:50:50.142ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:233
2872024-11-04T23:50:50.142ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-11-04T23:50:50.142ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2892024-11-04T23:50:50.142ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
2902024-11-04T23:50:50.177ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2912024-11-04T23:50:50.184ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a7cbccab-0e4b-441b-8c32-0d4fd283b1f2/crypt/zone file = sled-storage/src/dataset.rs:288
2922024-11-04T23:50:50.360ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 file = sled-storage/src/dataset.rs:374
2932024-11-04T23:50:50.365ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/probe_manager.rs:231 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
2942024-11-04T23:50:50.370ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2952024-11-04T23:50:50.370ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2962024-11-04T23:50:50.370ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2972024-11-04T23:50:50.370ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2982024-11-04T23:50:50.370ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2992024-11-04T23:50:50.380ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
3002024-11-04T23:50:50.380ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool)
3012024-11-04T23:50:50.473ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }
3022024-11-04T23:50:50.481ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:225
3032024-11-04T23:50:50.481ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:227
3042024-11-04T23:50:50.481ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:231
3052024-11-04T23:50:50.481ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:233
3062024-11-04T23:50:50.481ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3072024-11-04T23:50:50.481ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3082024-11-04T23:50:50.481ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3092024-11-04T23:50:50.516ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3102024-11-04T23:50:50.525ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b5c4456c-1550-488e-a3c6-7a939b550b2b/crypt/zone file = sled-storage/src/dataset.rs:288
3112024-11-04T23:50:50.695ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b5c4456c-1550-488e-a3c6-7a939b550b2b file = sled-storage/src/dataset.rs:374
3122024-11-04T23:50:50.702ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3132024-11-04T23:50:50.702ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3142024-11-04T23:50:50.702ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3152024-11-04T23:50:50.702ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3162024-11-04T23:50:50.703ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3172024-11-04T23:50:50.713ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3182024-11-04T23:50:50.713ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool)
3192024-11-04T23:50:50.807ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }
3202024-11-04T23:50:50.815ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:225
3212024-11-04T23:50:50.815ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:227
3222024-11-04T23:50:50.815ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:231
3232024-11-04T23:50:50.815ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:233
3242024-11-04T23:50:50.815ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3252024-11-04T23:50:50.815ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3262024-11-04T23:50:50.815ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3272024-11-04T23:50:50.850ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3282024-11-04T23:50:50.858ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8c7bfacc-ee49-4b61-8144-c219a6f7eec1/crypt/zone file = sled-storage/src/dataset.rs:288
3292024-11-04T23:50:51.036ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8c7bfacc-ee49-4b61-8144-c219a6f7eec1 file = sled-storage/src/dataset.rs:374
3302024-11-04T23:50:51.044ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3312024-11-04T23:50:51.044ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3322024-11-04T23:50:51.044ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3332024-11-04T23:50:51.044ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3342024-11-04T23:50:51.044ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3352024-11-04T23:50:51.053ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3362024-11-04T23:50:51.053ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool)
3372024-11-04T23:50:51.146ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool), kind: External }
3382024-11-04T23:50:51.154ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:225
3392024-11-04T23:50:51.154ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:227
3402024-11-04T23:50:51.154ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:231
3412024-11-04T23:50:51.154ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:233
3422024-11-04T23:50:51.154ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3432024-11-04T23:50:51.154ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3442024-11-04T23:50:51.154ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3452024-11-04T23:50:51.189ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3462024-11-04T23:50:51.197ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3f4115a5-5de9-472a-ac27-660d79d3d1f7/crypt/zone file = sled-storage/src/dataset.rs:288
3472024-11-04T23:50:51.367ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/probe_manager.rs:231 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
3482024-11-04T23:50:51.374ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3f4115a5-5de9-472a-ac27-660d79d3d1f7 file = sled-storage/src/dataset.rs:374
3492024-11-04T23:50:51.381ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3502024-11-04T23:50:51.382ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3512024-11-04T23:50:51.382ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3522024-11-04T23:50:51.382ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3532024-11-04T23:50:51.382ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3542024-11-04T23:50:51.391ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3552024-11-04T23:50:51.391ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6634f6ec-a171-4828-a984-8fb31f78439b (zpool)
3562024-11-04T23:50:51.489ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 6634f6ec-a171-4828-a984-8fb31f78439b (zpool), kind: External }
3572024-11-04T23:50:51.497ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:225
3582024-11-04T23:50:51.498ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:227
3592024-11-04T23:50:51.498ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:231
3602024-11-04T23:50:51.498ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:233
3612024-11-04T23:50:51.498ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3622024-11-04T23:50:51.498ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3632024-11-04T23:50:51.498ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3642024-11-04T23:50:51.532ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3652024-11-04T23:50:51.539ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6634f6ec-a171-4828-a984-8fb31f78439b/crypt/zone file = sled-storage/src/dataset.rs:288
3662024-11-04T23:50:51.712ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6634f6ec-a171-4828-a984-8fb31f78439b file = sled-storage/src/dataset.rs:374
3672024-11-04T23:50:51.720ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3682024-11-04T23:50:51.720ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3692024-11-04T23:50:51.720ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3702024-11-04T23:50:51.720ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3712024-11-04T23:50:51.720ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3722024-11-04T23:50:51.729ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3732024-11-04T23:50:51.729ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = aeae1e8c-da96-4cb8-a754-49b610133fd0 (zpool)
3742024-11-04T23:50:51.826ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: aeae1e8c-da96-4cb8-a754-49b610133fd0 (zpool), kind: External }
3752024-11-04T23:50:51.833ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:225
3762024-11-04T23:50:51.833ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:227
3772024-11-04T23:50:51.833ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:231
3782024-11-04T23:50:51.833ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:233
3792024-11-04T23:50:51.833ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3802024-11-04T23:50:51.834ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3812024-11-04T23:50:51.834ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
3822024-11-04T23:50:51.868ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3832024-11-04T23:50:51.876ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_aeae1e8c-da96-4cb8-a754-49b610133fd0/crypt/zone file = sled-storage/src/dataset.rs:288
3842024-11-04T23:50:52.052ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_aeae1e8c-da96-4cb8-a754-49b610133fd0 file = sled-storage/src/dataset.rs:374
3852024-11-04T23:50:52.061ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3862024-11-04T23:50:52.061ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3872024-11-04T23:50:52.061ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3882024-11-04T23:50:52.061ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3892024-11-04T23:50:52.061ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3902024-11-04T23:50:52.071ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3912024-11-04T23:50:52.071ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ffa9fae5-11fd-49c9-ab91-90383e170a6c (zpool)
3922024-11-04T23:50:52.169ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: ffa9fae5-11fd-49c9-ab91-90383e170a6c (zpool), kind: External }
3932024-11-04T23:50:52.178ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:225
3942024-11-04T23:50:52.178ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:227
3952024-11-04T23:50:52.178ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:231
3962024-11-04T23:50:52.178ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:233
3972024-11-04T23:50:52.178ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3982024-11-04T23:50:52.178ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3992024-11-04T23:50:52.178ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4002024-11-04T23:50:52.213ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4012024-11-04T23:50:52.221ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ffa9fae5-11fd-49c9-ab91-90383e170a6c/crypt/zone file = sled-storage/src/dataset.rs:288
4022024-11-04T23:50:52.369ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/probe_manager.rs:231 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4032024-11-04T23:50:52.406ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ffa9fae5-11fd-49c9-ab91-90383e170a6c file = sled-storage/src/dataset.rs:374
4042024-11-04T23:50:52.415ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4052024-11-04T23:50:52.415ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4062024-11-04T23:50:52.415ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4072024-11-04T23:50:52.415ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4082024-11-04T23:50:52.415ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4092024-11-04T23:50:52.425ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4102024-11-04T23:50:52.425ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7bc77ba6-9886-4954-bc34-bc232ce1413f (zpool)
4112024-11-04T23:50:52.519ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 7bc77ba6-9886-4954-bc34-bc232ce1413f (zpool), kind: External }
4122024-11-04T23:50:52.527ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:225
4132024-11-04T23:50:52.527ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:227
4142024-11-04T23:50:52.527ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:231
4152024-11-04T23:50:52.527ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:233
4162024-11-04T23:50:52.527ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4172024-11-04T23:50:52.527ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4182024-11-04T23:50:52.527ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4192024-11-04T23:50:52.562ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4202024-11-04T23:50:52.570ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7bc77ba6-9886-4954-bc34-bc232ce1413f/crypt/zone file = sled-storage/src/dataset.rs:288
4212024-11-04T23:50:52.754ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7bc77ba6-9886-4954-bc34-bc232ce1413f file = sled-storage/src/dataset.rs:374
4222024-11-04T23:50:52.763ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4232024-11-04T23:50:52.763ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4242024-11-04T23:50:52.763ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4252024-11-04T23:50:52.763ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4262024-11-04T23:50:52.763ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4272024-11-04T23:50:52.773ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4282024-11-04T23:50:52.773ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7449cf8d-6d8a-4759-b257-0067c28bc087 (zpool)
4292024-11-04T23:50:52.867ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:181 zpool = ZpoolName { id: 7449cf8d-6d8a-4759-b257-0067c28bc087 (zpool), kind: External }
4302024-11-04T23:50:52.875ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:225
4312024-11-04T23:50:52.875ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:227
4322024-11-04T23:50:52.875ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:231
4332024-11-04T23:50:52.875ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:233
4342024-11-04T23:50:52.875ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4352024-11-04T23:50:52.875ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4362024-11-04T23:50:52.875ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:245
4372024-11-04T23:50:52.911ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4382024-11-04T23:50:52.919ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7449cf8d-6d8a-4759-b257-0067c28bc087/crypt/zone file = sled-storage/src/dataset.rs:288
4392024-11-04T23:50:53.099ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7449cf8d-6d8a-4759-b257-0067c28bc087 file = sled-storage/src/dataset.rs:374
4402024-11-04T23:50:53.108ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4412024-11-04T23:50:53.108ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4422024-11-04T23:50:53.108ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4432024-11-04T23:50:53.108ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6e4a40d2-b3cd-4961-8098-a9d57834f0b0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fde07b41-a029-4be1-85a1-4d19a7248f1f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6634f6ec-a171-4828-a984-8fb31f78439b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: aeae1e8c-da96-4cb8-a754-49b610133fd0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ffa9fae5-11fd-49c9-ab91-90383e170a6c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7bc77ba6-9886-4954-bc34-bc232ce1413f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7449cf8d-6d8a-4759-b257-0067c28bc087 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4442024-11-04T23:50:53.108ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4452024-11-04T23:50:53.108ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4462024-11-04T23:50:53.108ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4472024-11-04T23:50:53.108ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:890 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4482024-11-04T23:50:53.108ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4492024-11-04T23:50:53.108ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:916 generation = Generation(1) sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4502024-11-04T23:50:53.108ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:921 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4512024-11-04T23:50:53.108ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:926 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4522024-11-04T23:50:53.108ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4532024-11-04T23:50:53.108ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:932 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4542024-11-04T23:50:53.108ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4552024-11-04T23:50:53.108ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:937 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4562024-11-04T23:50:53.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3227520 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50713 req_id = 4e465144-98cd-46ef-8cae-fe119b3f33dd response_code = 200 uri = /omicron-physical-disks
4572024-11-04T23:50:53.139ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 08f058bf-bffa-4561-8799-2d5d32641d33 (service), filesystem_pool: Some(ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9 (service), filesystem_pool: Some(ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 3e5a3f00-3f5b-4cac-8aa4-99515a0afee2 (service), filesystem_pool: Some(ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
4582024-11-04T23:50:53.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52851
4592024-11-04T23:50:53.140ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 08f058bf-bffa-4561-8799-2d5d32641d33, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4602024-11-04T23:50:53.140ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 08f058bf-bffa-4561-8799-2d5d32641d33, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4612024-11-04T23:50:53.189ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9, dataset_name: DatasetName { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4622024-11-04T23:50:53.189ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9, dataset_name: DatasetName { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }, kind: InternalDns }, responder: ... }
4632024-11-04T23:50:53.240ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3e5a3f00-3f5b-4cac-8aa4-99515a0afee2, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4642024-11-04T23:50:53.240ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 3e5a3f00-3f5b-4cac-8aa4-99515a0afee2, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4652024-11-04T23:50:53.288ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4662024-11-04T23:50:53.288ZINFOSledAgent (ServiceManager): No ledger in /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/omicron-zones.json file = common/src/ledger.rs:188
4672024-11-04T23:50:53.288ZINFOSledAgent (ServiceManager): No ledger in /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/omicron-zones.json file = common/src/ledger.rs:188
4682024-11-04T23:50:53.288ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4692024-11-04T23:50:53.333ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4702024-11-04T23:50:53.333ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4712024-11-04T23:50:53.333ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4722024-11-04T23:50:53.372ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/probe_manager.rs:231 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4732024-11-04T23:50:53.385ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33 file = illumos-utils/src/zone.rs:325
4742024-11-04T23:50:53.388ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9 file = illumos-utils/src/zone.rs:325
4752024-11-04T23:50:53.392ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2 file = illumos-utils/src/zone.rs:325
4762024-11-04T23:50:53.405ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33 file = illumos-utils/src/zone.rs:363
4772024-11-04T23:50:53.409ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9 file = illumos-utils/src/zone.rs:363
4782024-11-04T23:50:53.413ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2 file = illumos-utils/src/zone.rs:363
4792024-11-04T23:50:54.374ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/probe_manager.rs:231 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
4802024-11-04T23:50:54.989ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4812024-11-04T23:50:54.990ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
4822024-11-04T23:50:54.990ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33
4832024-11-04T23:50:55.475ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4842024-11-04T23:50:55.954ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
4852024-11-04T23:50:55.955ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4862024-11-04T23:50:55.955ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
4872024-11-04T23:50:55.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33") failed: Property not found. retry in 31.285308ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33
4882024-11-04T23:50:55.963ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9
4892024-11-04T23:50:55.967ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2
4902024-11-04T23:50:56.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33") failed: Property not found. retry in 137.715565ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33
4912024-11-04T23:50:56.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9") failed: Property not found. retry in 31.073186ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9
4922024-11-04T23:50:56.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2") failed: Property not found. retry in 47.688567ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2
4932024-11-04T23:50:56.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9") failed: Property not found. retry in 137.490564ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9
4942024-11-04T23:50:56.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33") failed: Property not found. retry in 282.717549ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33
4952024-11-04T23:50:56.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2") failed: Property not found. retry in 88.110472ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2
4962024-11-04T23:50:56.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9") failed: Property not found. retry in 259.774708ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9
4972024-11-04T23:50:56.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2") failed: Property not found. retry in 134.074697ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2
4982024-11-04T23:50:56.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33") failed: Property not found. retry in 541.028099ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33
4992024-11-04T23:50:56.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2") failed: Property not found. retry in 573.517884ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2
5002024-11-04T23:50:56.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9") failed: Property not found. retry in 264.930155ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9
5012024-11-04T23:50:56.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9") failed: Property not found. retry in 1.030602677s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9
5022024-11-04T23:50:57.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33") failed: Property not found. retry in 1.103034897s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33
5032024-11-04T23:50:57.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2") failed: Property not found. retry in 507.786826ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2
5042024-11-04T23:50:57.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2") failed: Property not found. retry in 761.384361ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2
5052024-11-04T23:50:57.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9") failed: Property not found. retry in 1.127110119s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9
5062024-11-04T23:50:58.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33") failed: Property not found. retry in 1.300858496s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33
5072024-11-04T23:50:58.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2") failed: Property not found. retry in 1.317950489s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2
5082024-11-04T23:50:58.928ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4254
5092024-11-04T23:50:58.928ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4264 gateway = fd00:1122:3344:101::1
5102024-11-04T23:50:58.934ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4343
5112024-11-04T23:50:59.042ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4391
5122024-11-04T23:50:59.042ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4418
5132024-11-04T23:50:59.087ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4431
5142024-11-04T23:50:59.087ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4295
5152024-11-04T23:50:59.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9") failed: Property not found. retry in 762.277762ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9
5162024-11-04T23:50:59.148ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4337
5172024-11-04T23:50:59.148ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4398 rack_subnet = fd00:1122:3344::
5182024-11-04T23:50:59.171ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4409
5192024-11-04T23:50:59.171ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4451
5202024-11-04T23:50:59.238ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4483
5212024-11-04T23:50:59.238ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4489
5222024-11-04T23:50:59.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::2]:53421
5232024-11-04T23:50:59.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::2]:53421 req_id = 5871421c-a0b9-4447-b719-b51e2e5f583e response_code = 200 uri = /sled-identifiers
5242024-11-04T23:50:59.327ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4530
5252024-11-04T23:50:59.327ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
5262024-11-04T23:50:59.328ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15967460110448876802 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
5272024-11-04T23:50:59.328ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13198898531374164349 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
5282024-11-04T23:50:59.359ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
5292024-11-04T23:50:59.390ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
5302024-11-04T23:50:59.390ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
5312024-11-04T23:50:59.391ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 0
5322024-11-04T23:50:59.391ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
5332024-11-04T23:50:59.428ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
5342024-11-04T23:50:59.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33") failed: Property not found. retry in 676.955445ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33
5352024-11-04T23:50:59.475ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
5362024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5372024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5382024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5392024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5402024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5412024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5422024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5432024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5442024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5452024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5462024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5472024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5482024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5492024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5502024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5512024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5522024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5532024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5542024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5552024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5562024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5572024-11-04T23:50:59.475ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5582024-11-04T23:50:59.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2") failed: Property not found. retry in 1.323709707s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2
5592024-11-04T23:50:59.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9") failed: Property not found. retry in 1.000992886s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9
5602024-11-04T23:51:00.029ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14601085485859320040 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
5612024-11-04T23:51:00.030ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3790918871880139736 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
5622024-11-04T23:51:00.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33") failed: Property not found. retry in 952.579149ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33
5632024-11-04T23:51:00.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9") failed: Property not found. retry in 1.404566247s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9
5642024-11-04T23:51:02.295ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_08f058bf-bffa-4561-8799-2d5d32641d33
5652024-11-04T23:51:02.295ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9
5662024-11-04T23:51:02.295ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_3e5a3f00-3f5b-4cac-8aa4-99515a0afee2
5672024-11-04T23:51:02.295ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5682024-11-04T23:51:02.296ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5692024-11-04T23:51:02.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9156684 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:52851 req_id = d25e53b5-883c-47d3-ac56-99d96f0d07a7 response_code = 204 uri = /omicron-zones
5702024-11-04T23:51:02.298ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5712024-11-04T23:51:02.347ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5722024-11-04T23:51:02.391ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5732024-11-04T23:51:02.436ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:612
5742024-11-04T23:51:02.436ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
5752024-11-04T23:51:02.468ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
5762024-11-04T23:51:02.469ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
5772024-11-04T23:51:02.469ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
5782024-11-04T23:51:02.498ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 08f058bf-bffa-4561-8799-2d5d32641d33 (service), filesystem_pool: Some(ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9 (service), filesystem_pool: Some(ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 3e5a3f00-3f5b-4cac-8aa4-99515a0afee2 (service), filesystem_pool: Some(ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 516fa14e-92ef-48d5-8580-a2de3ae5f4ed (service), filesystem_pool: Some(ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4668d180-5be4-44bf-aa6f-aed21389f6ef, kind: Service { id: 516fa14e-92ef-48d5-8580-a2de3ae5f4ed }, name: Name("ntp-516fa14e-92ef-48d5-8580-a2de3ae5f4ed"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 74])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
5792024-11-04T23:51:02.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43781
5802024-11-04T23:51:02.498ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 08f058bf-bffa-4561-8799-2d5d32641d33, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5812024-11-04T23:51:02.498ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 08f058bf-bffa-4561-8799-2d5d32641d33, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5822024-11-04T23:51:02.519ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9, dataset_name: DatasetName { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5832024-11-04T23:51:02.520ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9, dataset_name: DatasetName { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }, kind: InternalDns }, responder: ... }
5842024-11-04T23:51:02.538ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3e5a3f00-3f5b-4cac-8aa4-99515a0afee2, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5852024-11-04T23:51:02.538ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 3e5a3f00-3f5b-4cac-8aa4-99515a0afee2, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5862024-11-04T23:51:02.557ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5872024-11-04T23:51:02.557ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/omicron-zones.json file = common/src/ledger.rs:177
5882024-11-04T23:51:02.557ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/omicron-zones.json file = common/src/ledger.rs:177
5892024-11-04T23:51:02.557ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5902024-11-04T23:51:02.568ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
5912024-11-04T23:51:02.598ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
5922024-11-04T23:51:02.599ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
5932024-11-04T23:51:02.599ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
5942024-11-04T23:51:02.628ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 163, 74]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
5952024-11-04T23:51:02.628ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = boundary_ntp
5962024-11-04T23:51:02.628ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
5972024-11-04T23:51:02.628ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
5982024-11-04T23:51:02.629ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
5992024-11-04T23:51:02.629ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
6002024-11-04T23:51:02.650ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed file = illumos-utils/src/zone.rs:325
6012024-11-04T23:51:02.668ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed file = illumos-utils/src/zone.rs:363
6022024-11-04T23:51:03.301ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6032024-11-04T23:51:03.301ZINFOSledAgent (ServiceManager): Booting oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6042024-11-04T23:51:03.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 67.892038ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6052024-11-04T23:51:03.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 113.801926ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6062024-11-04T23:51:03.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 202.019065ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6072024-11-04T23:51:03.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 386.159691ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6082024-11-04T23:51:04.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 700.872073ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6092024-11-04T23:51:04.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 540.904427ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6102024-11-04T23:51:05.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 1.342176518s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6112024-11-04T23:51:06.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 1.404538788s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6122024-11-04T23:51:08.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 1.384751461s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6132024-11-04T23:51:09.330ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15967460110448876802 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
6142024-11-04T23:51:09.330ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13198898531374164349 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
6152024-11-04T23:51:09.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 671.243211ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6162024-11-04T23:51:10.031ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14601085485859320040 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
6172024-11-04T23:51:10.032ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3790918871880139736 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
6182024-11-04T23:51:10.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 1.336754804s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6192024-11-04T23:51:11.105ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4899980690625464344 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
6202024-11-04T23:51:11.110ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10350342619038347227 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
6212024-11-04T23:51:11.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 715.463443ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6222024-11-04T23:51:12.298ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14555741125520315823 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
6232024-11-04T23:51:12.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 1.044221175s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6242024-11-04T23:51:13.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 526.426162ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6252024-11-04T23:51:14.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 1.407909268s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6262024-11-04T23:51:15.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 534.853522ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6272024-11-04T23:51:15.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 1.405963745s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6282024-11-04T23:51:17.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed") failed: Property not found. retry in 1.366977297s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6292024-11-04T23:51:18.780ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed
6302024-11-04T23:51:18.780ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6312024-11-04T23:51:18.781ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6322024-11-04T23:51:18.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 16283241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43781 req_id = f08865bf-7bc9-4a05-b2f4-602798e0d8f7 response_code = 204 uri = /omicron-zones
6332024-11-04T23:51:18.783ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:653
6342024-11-04T23:51:18.813ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6352024-11-04T23:51:18.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51016
6362024-11-04T23:51:18.822ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6372024-11-04T23:51:18.822ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8600 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51016 req_id = b0189b0a-5b73-4b0b-8445-e6b5a4fffa17 response_code = 500 uri = /timesync
6382024-11-04T23:51:18.824ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6392024-11-04T23:51:18.927ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6402024-11-04T23:51:18.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53505
6412024-11-04T23:51:19.333ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15967460110448876802 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
6422024-11-04T23:51:19.333ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13198898531374164349 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
6432024-11-04T23:51:20.033ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14601085485859320040 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
6442024-11-04T23:51:20.033ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3790918871880139736 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
6452024-11-04T23:51:20.999ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 190.923962ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
6462024-11-04T23:51:21.107ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4899980690625464344 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
6472024-11-04T23:51:21.112ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10350342619038347227 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
6482024-11-04T23:51:22.300ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14555741125520315823 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
6492024-11-04T23:51:22.935ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6502024-11-04T23:51:22.935ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4008156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53505 req_id = ae6caabf-92cf-41c6-baaa-c6e145999309 response_code = 500 uri = /timesync
6512024-11-04T23:51:22.937ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6522024-11-04T23:51:23.087ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6532024-11-04T23:51:23.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63372
6542024-11-04T23:51:23.096ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6552024-11-04T23:51:23.097ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 9167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63372 req_id = 90cc2931-8a2b-4c41-a162-0edeee4a164a response_code = 500 uri = /timesync
6562024-11-04T23:51:23.100ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6572024-11-04T23:51:23.306ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6582024-11-04T23:51:23.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57722
6592024-11-04T23:51:23.314ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_516fa14e-92ef-48d5-8580-a2de3ae5f4ed': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6602024-11-04T23:51:23.315ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57722 req_id = c4f4dbfa-25f7-4b7b-a006-a7a244fa03a8 response_code = 500 uri = /timesync
6612024-11-04T23:51:23.318ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6622024-11-04T23:51:23.446ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6632024-11-04T23:51:23.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58181
6642024-11-04T23:51:25.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2009060 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58181 req_id = 609b5efd-a8b1-4457-8f60-7b9b0aa2e15e response_code = 200 uri = /timesync
6652024-11-04T23:51:25.458ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6662024-11-04T23:51:25.458ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6672024-11-04T23:51:25.749ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6682024-11-04T23:51:25.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44262
6692024-11-04T23:51:25.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7814 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44262 req_id = 24cbc834-e504-4925-aadc-050aff559e5c response_code = 200 uri = /timesync
6702024-11-04T23:51:25.759ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6712024-11-04T23:51:25.759ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6722024-11-04T23:51:25.947ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6732024-11-04T23:51:25.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33026
6742024-11-04T23:51:25.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33026 req_id = 4f7afe55-41d6-4598-9284-92aef3055adb response_code = 200 uri = /timesync
6752024-11-04T23:51:25.958ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6762024-11-04T23:51:25.958ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6772024-11-04T23:51:26.195ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6782024-11-04T23:51:26.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35979
6792024-11-04T23:51:26.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7972 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35979 req_id = 58e8e870-3a14-4e3a-b39c-be2ee7d6cef0 response_code = 200 uri = /timesync
6802024-11-04T23:51:26.205ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6812024-11-04T23:51:26.205ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6822024-11-04T23:51:26.488ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6832024-11-04T23:51:26.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44789
6842024-11-04T23:51:26.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44789 req_id = a701b6b2-a3c4-4af4-ba0f-84124bd2aa2f response_code = 200 uri = /timesync
6852024-11-04T23:51:26.500ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6862024-11-04T23:51:26.500ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6872024-11-04T23:51:27.398ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6882024-11-04T23:51:27.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44160
6892024-11-04T23:51:27.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7822 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44160 req_id = 39abf974-cd0a-462b-a521-d847d8a44750 response_code = 200 uri = /timesync
6902024-11-04T23:51:27.006ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6912024-11-04T23:51:27.006ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6922024-11-04T23:51:27.595ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6932024-11-04T23:51:27.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55369
6942024-11-04T23:51:27.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8841 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55369 req_id = 6cead4c4-ec7e-4ad4-b999-fa47fe3a88b9 response_code = 200 uri = /timesync
6952024-11-04T23:51:27.606ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
6962024-11-04T23:51:27.606ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6972024-11-04T23:51:28.060ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6982024-11-04T23:51:28.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32854
6992024-11-04T23:51:28.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8077 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32854 req_id = 903aecee-30c0-4668-bca6-1624b63b7a8a response_code = 200 uri = /timesync
7002024-11-04T23:51:28.071ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:661
7012024-11-04T23:51:28.071ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7022024-11-04T23:51:28.613ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7032024-11-04T23:51:28.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57255
7042024-11-04T23:51:28.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8547 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57255 req_id = 5b7c4392-4520-471c-8c87-de7ab7bace1c response_code = 200 uri = /timesync
7052024-11-04T23:51:28.624ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1730764288.6134644, correction: 0.282121152 } file = sled-agent/src/rack_setup/service.rs:661
7062024-11-04T23:51:28.624ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7072024-11-04T23:51:28.783ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15986420437490006896 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7082024-11-04T23:51:28.783ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4152049735916253354 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7092024-11-04T23:51:29.116ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56864
7102024-11-04T23:51:29.117ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56864 req_id = 528bc384-680d-4889-8bca-969a36e7d0e0 response_code = 200 uri = /baseboard
7112024-11-04T23:51:29.333ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15967460110448876802 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7122024-11-04T23:51:29.333ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13198898531374164349 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7132024-11-04T23:51:29.635ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7142024-11-04T23:51:29.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42066
7152024-11-04T23:51:29.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7831 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42066 req_id = 38034359-43a0-47aa-a411-26ebec8ab7ec response_code = 200 uri = /timesync
7162024-11-04T23:51:29.646ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730764287.3690934, correction: 0.283378601 } file = sled-agent/src/rack_setup/service.rs:661
7172024-11-04T23:51:29.646ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7182024-11-04T23:51:30.037ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14601085485859320040 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7192024-11-04T23:51:30.037ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3790918871880139736 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7202024-11-04T23:51:30.294ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7212024-11-04T23:51:30.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34819
7222024-11-04T23:51:30.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34819 req_id = bb6f384c-76b3-4ac9-b2d0-a0f7e02a3c8f response_code = 200 uri = /timesync
7232024-11-04T23:51:30.304ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730764287.3690934, correction: 0.281599522 } file = sled-agent/src/rack_setup/service.rs:661
7242024-11-04T23:51:30.304ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7252024-11-04T23:51:31.113ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4899980690625464344 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7262024-11-04T23:51:31.117ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10350342619038347227 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7272024-11-04T23:51:31.279ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7282024-11-04T23:51:31.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55414
7292024-11-04T23:51:31.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8453 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55414 req_id = 9ec5741c-bd3a-4636-a539-0d4c48d0424b response_code = 200 uri = /timesync
7302024-11-04T23:51:31.290ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730764287.3690934, correction: 0.275919765 } file = sled-agent/src/rack_setup/service.rs:661
7312024-11-04T23:51:31.290ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7322024-11-04T23:51:32.309ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14555741125520315823 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7332024-11-04T23:51:32.904ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7342024-11-04T23:51:32.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58196
7352024-11-04T23:51:32.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8879 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58196 req_id = fe568ba6-7923-48d5-9a94-64f7b1cb6771 response_code = 200 uri = /timesync
7362024-11-04T23:51:32.916ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730764287.3690934, correction: 0.271624088 } file = sled-agent/src/rack_setup/service.rs:661
7372024-11-04T23:51:32.916ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7382024-11-04T23:51:33.999ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7392024-11-04T23:51:33.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51516
7402024-11-04T23:51:34.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51516 req_id = aac9e719-99c2-4f97-b3a3-ff8de4f96398 response_code = 200 uri = /timesync
7412024-11-04T23:51:34.010ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1730764293.2321222, correction: 0.268684924 } file = sled-agent/src/rack_setup/service.rs:661
7422024-11-04T23:51:34.010ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7432024-11-04T23:51:35.503ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7442024-11-04T23:51:35.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39837
7452024-11-04T23:51:35.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8441 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39837 req_id = 7546e3b7-b33a-4fbd-8045-49c71799e576 response_code = 200 uri = /timesync
7462024-11-04T23:51:35.514ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1730764293.2321222, correction: 0.264620334 } file = sled-agent/src/rack_setup/service.rs:661
7472024-11-04T23:51:35.514ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7482024-11-04T23:51:36.241ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 564.02865ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7492024-11-04T23:51:37.973ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7502024-11-04T23:51:37.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38536
7512024-11-04T23:51:37.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8750 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38536 req_id = 84b30915-7972-4179-8202-3b8f0ac5767e response_code = 200 uri = /timesync
7522024-11-04T23:51:37.984ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1730764297.5957007, correction: 0.257294416 } file = sled-agent/src/rack_setup/service.rs:661
7532024-11-04T23:51:37.984ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7542024-11-04T23:51:38.813ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15986420437490006896 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7552024-11-04T23:51:38.813ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4152049735916253354 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7562024-11-04T23:51:39.361ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15967460110448876802 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7572024-11-04T23:51:39.363ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13198898531374164349 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7582024-11-04T23:51:40.067ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14601085485859320040 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7592024-11-04T23:51:40.067ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3790918871880139736 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7602024-11-04T23:51:41.142ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4899980690625464344 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7612024-11-04T23:51:41.145ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10350342619038347227 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7622024-11-04T23:51:41.430ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7632024-11-04T23:51:41.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47843
7642024-11-04T23:51:41.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8524 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47843 req_id = ea0d5200-38eb-4709-9ec7-62435def8338 response_code = 200 uri = /timesync
7652024-11-04T23:51:41.441ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1730764299.3761392, correction: 0.247966245 } file = sled-agent/src/rack_setup/service.rs:661
7662024-11-04T23:51:41.441ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7672024-11-04T23:51:42.339ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14555741125520315823 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7682024-11-04T23:51:44.464ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7692024-11-04T23:51:44.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37282
7702024-11-04T23:51:44.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8565 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37282 req_id = d07fba05-d1e3-4a91-8795-a3863cfc016c response_code = 200 uri = /timesync
7712024-11-04T23:51:44.475ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1730764302.6490855, correction: 0.239517257 } file = sled-agent/src/rack_setup/service.rs:661
7722024-11-04T23:51:44.475ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7732024-11-04T23:51:48.842ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15986420437490006896 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7742024-11-04T23:51:48.843ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4152049735916253354 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7752024-11-04T23:51:49.187ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7762024-11-04T23:51:49.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49737
7772024-11-04T23:51:49.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9957 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49737 req_id = 73ea44d6-3a47-4355-891e-139e2108e36c response_code = 200 uri = /timesync
7782024-11-04T23:51:49.199ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1730764307.3075576, correction: 0.226890668 } file = sled-agent/src/rack_setup/service.rs:661
7792024-11-04T23:51:49.199ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7802024-11-04T23:51:49.391ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15967460110448876802 reason = Duration(60s) sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7812024-11-04T23:51:49.392ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13198898531374164349 reason = Duration(60s) sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7822024-11-04T23:51:50.095ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14601085485859320040 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7832024-11-04T23:51:50.095ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3790918871880139736 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7842024-11-04T23:51:51.171ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4899980690625464344 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7852024-11-04T23:51:51.173ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10350342619038347227 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7862024-11-04T23:51:51.883ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.467751043s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7872024-11-04T23:51:52.368ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14555741125520315823 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7882024-11-04T23:51:55.781ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7892024-11-04T23:51:55.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55226
7902024-11-04T23:51:55.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8919 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55226 req_id = df4ac2cd-3291-481c-bd25-5de9d14496d1 response_code = 200 uri = /timesync
7912024-11-04T23:51:55.793ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1730764313.312152, correction: 0.209193423 } file = sled-agent/src/rack_setup/service.rs:661
7922024-11-04T23:51:55.793ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7932024-11-04T23:51:58.871ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15986420437490006896 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7942024-11-04T23:51:58.871ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4152049735916253354 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7952024-11-04T23:51:59.233ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44074
7962024-11-04T23:51:59.233ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44074 req_id = cc55d683-17f5-4b55-963b-f8693a0d1131 response_code = 200 uri = /baseboard
7972024-11-04T23:52:00.124ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14601085485859320040 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7982024-11-04T23:52:00.124ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3790918871880139736 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
7992024-11-04T23:52:01.201ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4899980690625464344 reason = Duration(60s) sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8002024-11-04T23:52:01.202ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 10350342619038347227 reason = Duration(60s) sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8012024-11-04T23:52:02.398ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 14555741125520315823 reason = Duration(60s) sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8022024-11-04T23:52:03.287ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8032024-11-04T23:52:03.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59648
8042024-11-04T23:52:03.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8547 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59648 req_id = 90011fd0-396f-4032-bbd5-96b868ded072 response_code = 200 uri = /timesync
8052024-11-04T23:52:03.298ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1730764321.4418917, correction: 0.188897803 } file = sled-agent/src/rack_setup/service.rs:661
8062024-11-04T23:52:03.298ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8072024-11-04T23:52:08.431ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.203200679s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8082024-11-04T23:52:08.473ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8092024-11-04T23:52:08.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34801
8102024-11-04T23:52:08.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8823 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34801 req_id = abfa6839-2fba-4ecf-be79-4c727d5adecf response_code = 200 uri = /timesync
8112024-11-04T23:52:08.485ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1730764328.027735, correction: 0.174909934 } file = sled-agent/src/rack_setup/service.rs:661
8122024-11-04T23:52:08.485ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8132024-11-04T23:52:08.902ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15986420437490006896 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8142024-11-04T23:52:08.902ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4152049735916253354 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8152024-11-04T23:52:10.153ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14601085485859320040 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8162024-11-04T23:52:10.153ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3790918871880139736 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8172024-11-04T23:52:18.931ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15986420437490006896 reason = Duration(60s) sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8182024-11-04T23:52:18.931ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4152049735916253354 reason = Duration(60s) sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8192024-11-04T23:52:19.445ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8202024-11-04T23:52:19.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48647
8212024-11-04T23:52:19.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48647 req_id = bac49823-63b6-4945-97aa-fc217e8b821f response_code = 200 uri = /timesync
8222024-11-04T23:52:19.459ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1730764337.4697554, correction: 0.145277247 } file = sled-agent/src/rack_setup/service.rs:661
8232024-11-04T23:52:19.459ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8242024-11-04T23:52:20.182ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14601085485859320040 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8252024-11-04T23:52:20.182ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3790918871880139736 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8262024-11-04T23:52:25.716ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.071884575s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8272024-11-04T23:52:28.203ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8282024-11-04T23:52:28.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54713
8292024-11-04T23:52:28.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8900 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54713 req_id = c42fc9ff-966c-4560-be87-15bd2b175ab3 response_code = 200 uri = /timesync
8302024-11-04T23:52:28.216ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1730764345.5333183, correction: 0.121598557 } file = sled-agent/src/rack_setup/service.rs:661
8312024-11-04T23:52:28.216ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8322024-11-04T23:52:29.346ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59915
8332024-11-04T23:52:29.346ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59915 req_id = 89853a47-b441-4ac0-a96e-0cdea3f28595 response_code = 200 uri = /baseboard
8342024-11-04T23:52:30.211ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14601085485859320040 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8352024-11-04T23:52:30.211ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3790918871880139736 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8362024-11-04T23:52:40.241ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14601085485859320040 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8372024-11-04T23:52:40.241ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3790918871880139736 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8382024-11-04T23:52:40.320ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8392024-11-04T23:52:40.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56188
8402024-11-04T23:52:40.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9079 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56188 req_id = 21340fa4-e6c3-44ad-962a-585d84390072 response_code = 200 uri = /timesync
8412024-11-04T23:52:40.333ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1730764357.8502498, correction: 0.088861741 } file = sled-agent/src/rack_setup/service.rs:661
8422024-11-04T23:52:40.333ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8432024-11-04T23:52:42.868ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 7.669584702s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8442024-11-04T23:52:50.269ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14601085485859320040 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8452024-11-04T23:52:50.269ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3790918871880139736 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8462024-11-04T23:52:57.083ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8472024-11-04T23:52:57.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56949
8482024-11-04T23:52:57.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 20277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56949 req_id = ff8867a7-037f-42b2-885e-809eb2c8fe8f response_code = 200 uri = /timesync
8492024-11-04T23:52:57.105ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-04T23:52:02.398606999Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 14555741125520315823 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8502024-11-04T23:52:57.106ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-04T23:51:49.392409272Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13198898531374164349 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8512024-11-04T23:52:57.106ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-04T23:52:01.201488827Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4899980690625464344 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8522024-11-04T23:52:57.106ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-04T23:52:18.931572390Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4152049735916253354 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8532024-11-04T23:52:57.106ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-04T23:51:49.391896253Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15967460110448876802 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8542024-11-04T23:52:57.107ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-04T23:52:01.202034641Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 10350342619038347227 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8552024-11-04T23:52:57.107ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-04T23:52:18.931317001Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15986420437490006896 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
8562024-11-04T23:52:57.108ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1730764370.1266065, correction: 0.043537494 } file = sled-agent/src/rack_setup/service.rs:661
8572024-11-04T23:52:57.108ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1308
8582024-11-04T23:52:57.137ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 08f058bf-bffa-4561-8799-2d5d32641d33 (service), filesystem_pool: Some(ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9 (service), filesystem_pool: Some(ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 3e5a3f00-3f5b-4cac-8aa4-99515a0afee2 (service), filesystem_pool: Some(ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 516fa14e-92ef-48d5-8580-a2de3ae5f4ed (service), filesystem_pool: Some(ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4668d180-5be4-44bf-aa6f-aed21389f6ef, kind: Service { id: 516fa14e-92ef-48d5-8580-a2de3ae5f4ed }, name: Name("ntp-516fa14e-92ef-48d5-8580-a2de3ae5f4ed"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 74])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 7b34d1ab-35ad-4b92-bb69-c4683c999a4e (service), filesystem_pool: Some(ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 63861feb-1bd1-4fae-8848-46c2b491b08d (service), filesystem_pool: Some(ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External } } } }, OmicronZoneConfig { id: 42f8c353-ecd2-4437-b12a-b408f08684c2 (service), filesystem_pool: Some(ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2f29cbb2-451f-4975-a1c9-03364380c77e (service), filesystem_pool: Some(ZpoolName { id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool), kind: External } } } }, OmicronZoneConfig { id: da93f7c3-c04a-4ffb-994d-072f2e0b92e0 (service), filesystem_pool: Some(ZpoolName { id: 6634f6ec-a171-4828-a984-8fb31f78439b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6634f6ec-a171-4828-a984-8fb31f78439b (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
8592024-11-04T23:52:57.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37376
8602024-11-04T23:52:57.137ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 08f058bf-bffa-4561-8799-2d5d32641d33, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8612024-11-04T23:52:57.137ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 08f058bf-bffa-4561-8799-2d5d32641d33, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8622024-11-04T23:52:57.160ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9, dataset_name: DatasetName { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8632024-11-04T23:52:57.160ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9, dataset_name: DatasetName { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }, kind: InternalDns }, responder: ... }
8642024-11-04T23:52:57.179ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3e5a3f00-3f5b-4cac-8aa4-99515a0afee2, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8652024-11-04T23:52:57.179ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 3e5a3f00-3f5b-4cac-8aa4-99515a0afee2, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8662024-11-04T23:52:57.198ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7b34d1ab-35ad-4b92-bb69-c4683c999a4e, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8672024-11-04T23:52:57.198ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 7b34d1ab-35ad-4b92-bb69-c4683c999a4e, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8682024-11-04T23:52:57.251ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 63861feb-1bd1-4fae-8848-46c2b491b08d, dataset_name: DatasetName { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8692024-11-04T23:52:57.251ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 63861feb-1bd1-4fae-8848-46c2b491b08d, dataset_name: DatasetName { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }, kind: Cockroach }, responder: ... }
8702024-11-04T23:52:57.303ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 42f8c353-ecd2-4437-b12a-b408f08684c2, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8712024-11-04T23:52:57.303ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 42f8c353-ecd2-4437-b12a-b408f08684c2, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8722024-11-04T23:52:57.353ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2f29cbb2-451f-4975-a1c9-03364380c77e, dataset_name: DatasetName { pool_name: ZpoolName { id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8732024-11-04T23:52:57.353ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 2f29cbb2-451f-4975-a1c9-03364380c77e, dataset_name: DatasetName { pool_name: ZpoolName { id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8742024-11-04T23:52:57.406ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: da93f7c3-c04a-4ffb-994d-072f2e0b92e0, dataset_name: DatasetName { pool_name: ZpoolName { id: 6634f6ec-a171-4828-a984-8fb31f78439b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8752024-11-04T23:52:57.406ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: da93f7c3-c04a-4ffb-994d-072f2e0b92e0, dataset_name: DatasetName { pool_name: ZpoolName { id: 6634f6ec-a171-4828-a984-8fb31f78439b (zpool), kind: External }, kind: Cockroach }, responder: ... }
8762024-11-04T23:52:57.457ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8772024-11-04T23:52:57.457ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/omicron-zones.json file = common/src/ledger.rs:177
8782024-11-04T23:52:57.457ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/omicron-zones.json file = common/src/ledger.rs:177
8792024-11-04T23:52:57.457ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8802024-11-04T23:52:57.539ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8812024-11-04T23:52:57.539ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8822024-11-04T23:52:57.539ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8832024-11-04T23:52:57.539ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8842024-11-04T23:52:57.539ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8852024-11-04T23:52:57.630ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2 file = illumos-utils/src/zone.rs:325
8862024-11-04T23:52:57.634ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e file = illumos-utils/src/zone.rs:325
8872024-11-04T23:52:57.639ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d file = illumos-utils/src/zone.rs:325
8882024-11-04T23:52:57.643ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0 file = illumos-utils/src/zone.rs:325
8892024-11-04T23:52:57.647ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e file = illumos-utils/src/zone.rs:325
8902024-11-04T23:52:57.651ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2 file = illumos-utils/src/zone.rs:363
8912024-11-04T23:52:57.656ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e file = illumos-utils/src/zone.rs:363
8922024-11-04T23:52:57.661ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d file = illumos-utils/src/zone.rs:363
8932024-11-04T23:52:57.665ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0 file = illumos-utils/src/zone.rs:363
8942024-11-04T23:52:57.669ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e file = illumos-utils/src/zone.rs:363
8952024-11-04T23:52:59.463ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63488
8962024-11-04T23:52:59.463ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63488 req_id = e3d3f707-fb76-4d6e-9c97-faeaa56840d1 response_code = 200 uri = /baseboard
8972024-11-04T23:53:00.560ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='da93f7c3-c04a-4ffb-994d-072f2e0b92e0'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8982024-11-04T23:53:00.560ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7b34d1ab-35ad-4b92-bb69-c4683c999a4e'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8992024-11-04T23:53:00.560ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9002024-11-04T23:53:00.565ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9012024-11-04T23:53:00.623ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='42f8c353-ecd2-4437-b12a-b408f08684c2'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9022024-11-04T23:53:00.623ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='2f29cbb2-451f-4975-a1c9-03364380c77e'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9032024-11-04T23:53:00.623ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9042024-11-04T23:53:00.628ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9052024-11-04T23:53:00.666ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='63861feb-1bd1-4fae-8848-46c2b491b08d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9062024-11-04T23:53:00.666ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9072024-11-04T23:53:00.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 59.539087ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9082024-11-04T23:53:00.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 51.594883ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9092024-11-04T23:53:00.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 32.230217ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9102024-11-04T23:53:00.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 32.129367ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9112024-11-04T23:53:00.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 75.267842ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9122024-11-04T23:53:00.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 53.645284ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9132024-11-04T23:53:01.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 131.62683ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9142024-11-04T23:53:01.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 290.133042ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9152024-11-04T23:53:01.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 245.076092ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9162024-11-04T23:53:01.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 146.887259ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9172024-11-04T23:53:01.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 278.650007ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9182024-11-04T23:53:01.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 35.145412ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9192024-11-04T23:53:01.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 329.827557ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9202024-11-04T23:53:02.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 101.418685ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9212024-11-04T23:53:02.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 453.022979ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9222024-11-04T23:53:02.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 181.460284ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9232024-11-04T23:53:03.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 500.301639ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9242024-11-04T23:53:03.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 949.95703ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9252024-11-04T23:53:03.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 197.534177ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9262024-11-04T23:53:03.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 509.254861ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9272024-11-04T23:53:03.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 344.479227ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9282024-11-04T23:53:03.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 992.049367ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9292024-11-04T23:53:03.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 1.031757837s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9302024-11-04T23:53:03.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 924.218463ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9312024-11-04T23:53:03.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 945.988012ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9322024-11-04T23:53:03.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 1.272898591s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9332024-11-04T23:53:04.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 943.862734ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9342024-11-04T23:53:04.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 558.877568ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9352024-11-04T23:53:04.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 521.933532ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9362024-11-04T23:53:04.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 1.375699099s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9372024-11-04T23:53:05.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 1.081022185s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9382024-11-04T23:53:05.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 745.06262ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9392024-11-04T23:53:05.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 725.624833ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9402024-11-04T23:53:05.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 643.640128ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9412024-11-04T23:53:05.635ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 23.535102888s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
9422024-11-04T23:53:05.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 1.431731164s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9432024-11-04T23:53:06.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 1.065915053s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9442024-11-04T23:53:06.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 1.10361928s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9452024-11-04T23:53:06.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 506.920281ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9462024-11-04T23:53:06.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 1.081136926s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9472024-11-04T23:53:06.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 1.250253104s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9482024-11-04T23:53:07.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 760.026828ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9492024-11-04T23:53:07.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 924.020868ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9502024-11-04T23:53:07.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 1.324247131s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9512024-11-04T23:53:07.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 1.381432173s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9522024-11-04T23:53:07.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 1.448547709s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9532024-11-04T23:53:07.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 1.016763987s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9542024-11-04T23:53:08.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 815.397783ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9552024-11-04T23:53:08.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 545.480732ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9562024-11-04T23:53:08.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 1.214479794s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9572024-11-04T23:53:08.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 991.437298ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9582024-11-04T23:53:08.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 597.299881ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9592024-11-04T23:53:09.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 755.292289ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9602024-11-04T23:53:09.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 928.599737ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9612024-11-04T23:53:09.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 522.74574ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9622024-11-04T23:53:09.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 551.264249ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9632024-11-04T23:53:09.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 915.32086ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9642024-11-04T23:53:09.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 950.667178ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9652024-11-04T23:53:10.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 1.21580992s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9662024-11-04T23:53:10.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 1.109316386s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9672024-11-04T23:53:10.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 1.328875629s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9682024-11-04T23:53:10.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 543.740064ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9692024-11-04T23:53:10.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 1.420789712s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9702024-11-04T23:53:11.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 827.488034ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9712024-11-04T23:53:11.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 800.522772ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9722024-11-04T23:53:11.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 1.068895086s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9732024-11-04T23:53:11.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 1.451469804s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9742024-11-04T23:53:12.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 1.161239307s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9752024-11-04T23:53:12.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 929.82346ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9762024-11-04T23:53:12.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 1.253323706s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9772024-11-04T23:53:12.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 623.197033ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9782024-11-04T23:53:13.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 577.049677ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9792024-11-04T23:53:13.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 1.176292133s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9802024-11-04T23:53:13.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 874.81221ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9812024-11-04T23:53:13.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 1.240136608s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9822024-11-04T23:53:13.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 994.836845ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9832024-11-04T23:53:13.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 958.927424ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9842024-11-04T23:53:14.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 1.393015247s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9852024-11-04T23:53:14.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 1.273399766s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9862024-11-04T23:53:14.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 977.925612ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9872024-11-04T23:53:14.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 942.27409ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9882024-11-04T23:53:14.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 1.293120677s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9892024-11-04T23:53:15.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 1.189413244s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9902024-11-04T23:53:15.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 732.041689ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9912024-11-04T23:53:15.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 1.376486485s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9922024-11-04T23:53:15.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 1.142147856s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9932024-11-04T23:53:15.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 1.097971745s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9942024-11-04T23:53:16.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 1.332374508s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
9952024-11-04T23:53:16.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0") failed: Property not found. retry in 1.23845746s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
9962024-11-04T23:53:16.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 680.904468ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
9972024-11-04T23:53:16.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 660.807363ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
9982024-11-04T23:53:17.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e") failed: Property not found. retry in 1.344916649s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
9992024-11-04T23:53:17.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 1.411867751s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
10002024-11-04T23:53:17.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e") failed: Property not found. retry in 735.857801ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
10012024-11-04T23:53:17.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 830.466515ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
10022024-11-04T23:53:18.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 1.356119063s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
10032024-11-04T23:53:18.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 669.429927ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
10042024-11-04T23:53:19.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 692.898059ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
10052024-11-04T23:53:19.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 999.737557ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
10062024-11-04T23:53:20.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 624.563709ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
10072024-11-04T23:53:20.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 1.192073728s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
10082024-11-04T23:53:20.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 1.483257869s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
10092024-11-04T23:53:22.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 1.436065413s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
10102024-11-04T23:53:22.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 781.703523ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
10112024-11-04T23:53:23.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 937.556493ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
10122024-11-04T23:53:23.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 1.38019553s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
10132024-11-04T23:53:24.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 1.004406764s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
10142024-11-04T23:53:24.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 1.470213876s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
10152024-11-04T23:53:25.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 1.061758583s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
10162024-11-04T23:53:26.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2") failed: Property not found. retry in 1.445977544s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
10172024-11-04T23:53:26.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 1.02295805s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
10182024-11-04T23:53:27.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d") failed: Property not found. retry in 813.752233ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
10192024-11-04T23:53:28.262ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_42f8c353-ecd2-4437-b12a-b408f08684c2
10202024-11-04T23:53:28.262ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_7b34d1ab-35ad-4b92-bb69-c4683c999a4e
10212024-11-04T23:53:28.262ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_63861feb-1bd1-4fae-8848-46c2b491b08d
10222024-11-04T23:53:28.262ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_da93f7c3-c04a-4ffb-994d-072f2e0b92e0
10232024-11-04T23:53:28.262ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_2f29cbb2-451f-4975-a1c9-03364380c77e
10242024-11-04T23:53:28.262ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10252024-11-04T23:53:28.262ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10262024-11-04T23:53:28.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31081565 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37376 req_id = 183349ea-1309-478e-b781-0ac879ebedeb response_code = 204 uri = /omicron-zones
10272024-11-04T23:53:28.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35806
10282024-11-04T23:53:28.325ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3705
10292024-11-04T23:53:43.878ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3723
10302024-11-04T23:53:47.741ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3746
10312024-11-04T23:53:47.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 19443984 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:35806 req_id = 022d263e-75c3-4f47-a878-b7c4f8f82c4d response_code = 204 uri = /cockroachdb
10322024-11-04T23:53:47.742ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61814
10332024-11-04T23:53:47.784ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 08f058bf-bffa-4561-8799-2d5d32641d33 (service), filesystem_pool: Some(ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9 (service), filesystem_pool: Some(ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 3e5a3f00-3f5b-4cac-8aa4-99515a0afee2 (service), filesystem_pool: Some(ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 516fa14e-92ef-48d5-8580-a2de3ae5f4ed (service), filesystem_pool: Some(ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4668d180-5be4-44bf-aa6f-aed21389f6ef, kind: Service { id: 516fa14e-92ef-48d5-8580-a2de3ae5f4ed }, name: Name("ntp-516fa14e-92ef-48d5-8580-a2de3ae5f4ed"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 74])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 7b34d1ab-35ad-4b92-bb69-c4683c999a4e (service), filesystem_pool: Some(ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 63861feb-1bd1-4fae-8848-46c2b491b08d (service), filesystem_pool: Some(ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External } } } }, OmicronZoneConfig { id: 42f8c353-ecd2-4437-b12a-b408f08684c2 (service), filesystem_pool: Some(ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2f29cbb2-451f-4975-a1c9-03364380c77e (service), filesystem_pool: Some(ZpoolName { id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool), kind: External } } } }, OmicronZoneConfig { id: da93f7c3-c04a-4ffb-994d-072f2e0b92e0 (service), filesystem_pool: Some(ZpoolName { id: 6634f6ec-a171-4828-a984-8fb31f78439b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6634f6ec-a171-4828-a984-8fb31f78439b (zpool), kind: External } } } }, OmicronZoneConfig { id: d840e2fc-5a49-44c2-87c1-9190f4e47113 (service), filesystem_pool: Some(ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 7155d12f-56d4-469c-89f3-97766104983b, kind: Service { id: d840e2fc-5a49-44c2-87c1-9190f4e47113 }, name: Name("external-dns-d840e2fc-5a49-44c2-87c1-9190f4e47113"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295 (service), filesystem_pool: Some(ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: da209965-7111-4076-a7e7-ba8fb40d3572, kind: Service { id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295 }, name: Name("external-dns-5f4c9dd5-dad6-4fc2-ba58-b064adbea295"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 2bc59dd6-be0a-4755-adc1-2be053a1e284 (service), filesystem_pool: Some(ZpoolName { id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: e75b87c5-0d01-4e92-b145-05ce8da9b4ce, kind: Service { id: 2bc59dd6-be0a-4755-adc1-2be053a1e284 }, name: Name("nexus-2bc59dd6-be0a-4755-adc1-2be053a1e284"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 96aa1415-4c39-4ede-a09d-b8326a8455f7 (service), filesystem_pool: Some(ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: ee017e11-2d79-4135-9b0e-ae0d2aaa0345, kind: Service { id: 96aa1415-4c39-4ede-a09d-b8326a8455f7 }, name: Name("nexus-96aa1415-4c39-4ede-a09d-b8326a8455f7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd (service), filesystem_pool: Some(ZpoolName { id: ffa9fae5-11fd-49c9-ab91-90383e170a6c (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: b3056cef-70ef-4c2c-9b47-f29485e812ed, kind: Service { id: 3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd }, name: Name("nexus-3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 936f0bc7-d5c8-4edc-b21c-cc06e01960a5 (service), filesystem_pool: Some(ZpoolName { id: 7bc77ba6-9886-4954-bc34-bc232ce1413f (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 015507f2-2134-4114-90c1-5f26064ff0df (service), filesystem_pool: Some(ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External } } } }, OmicronZoneConfig { id: b930d7eb-6301-4cf2-93ec-040c1daafc18 (service), filesystem_pool: Some(ZpoolName { id: ffa9fae5-11fd-49c9-ab91-90383e170a6c (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: df6c6890-893f-4aa0-ae25-285394f5f40e (service), filesystem_pool: Some(ZpoolName { id: 7449cf8d-6d8a-4759-b257-0067c28bc087 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 103f312a-a7ef-4d88-a957-51e81c91d2b2 (service), filesystem_pool: Some(ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: f13d593d-030a-434d-a7a2-8524a3d27d51 (service), filesystem_pool: Some(ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5 (service), filesystem_pool: Some(ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External } } } }, OmicronZoneConfig { id: 8c826fff-76ef-40ff-bc7e-e67b6d59e7d7 (service), filesystem_pool: Some(ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External } } } }, OmicronZoneConfig { id: c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78 (service), filesystem_pool: Some(ZpoolName { id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool), kind: External } } } }, OmicronZoneConfig { id: cadbf9c6-7b34-4140-87d4-d298bb7d7fa4 (service), filesystem_pool: Some(ZpoolName { id: 6634f6ec-a171-4828-a984-8fb31f78439b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6634f6ec-a171-4828-a984-8fb31f78439b (zpool), kind: External } } } }, OmicronZoneConfig { id: 5564e11e-42ce-47de-aa70-90efe5750a93 (service), filesystem_pool: Some(ZpoolName { id: aeae1e8c-da96-4cb8-a754-49b610133fd0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: aeae1e8c-da96-4cb8-a754-49b610133fd0 (zpool), kind: External } } } }, OmicronZoneConfig { id: b3584514-7414-4d9d-8b44-bc78badc90df (service), filesystem_pool: Some(ZpoolName { id: ffa9fae5-11fd-49c9-ab91-90383e170a6c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ffa9fae5-11fd-49c9-ab91-90383e170a6c (zpool), kind: External } } } }, OmicronZoneConfig { id: aae166ac-eeb9-49fd-8c35-949be561350c (service), filesystem_pool: Some(ZpoolName { id: 7bc77ba6-9886-4954-bc34-bc232ce1413f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7bc77ba6-9886-4954-bc34-bc232ce1413f (zpool), kind: External } } } }, OmicronZoneConfig { id: 3063cc09-aec0-4a7e-9f10-942e2ac49629 (service), filesystem_pool: Some(ZpoolName { id: 7449cf8d-6d8a-4759-b257-0067c28bc087 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7449cf8d-6d8a-4759-b257-0067c28bc087 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
10342024-11-04T23:53:47.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53678
10352024-11-04T23:53:47.785ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 08f058bf-bffa-4561-8799-2d5d32641d33, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10362024-11-04T23:53:47.785ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 08f058bf-bffa-4561-8799-2d5d32641d33, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10372024-11-04T23:53:47.808ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9, dataset_name: DatasetName { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10382024-11-04T23:53:47.808ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: f97a5e43-7a5a-4a12-a3a5-8cc2e41718b9, dataset_name: DatasetName { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }, kind: InternalDns }, responder: ... }
10392024-11-04T23:53:47.828ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3e5a3f00-3f5b-4cac-8aa4-99515a0afee2, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10402024-11-04T23:53:47.828ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 3e5a3f00-3f5b-4cac-8aa4-99515a0afee2, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10412024-11-04T23:53:47.846ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7b34d1ab-35ad-4b92-bb69-c4683c999a4e, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10422024-11-04T23:53:47.846ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 7b34d1ab-35ad-4b92-bb69-c4683c999a4e, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10432024-11-04T23:53:47.864ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 63861feb-1bd1-4fae-8848-46c2b491b08d, dataset_name: DatasetName { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10442024-11-04T23:53:47.864ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 63861feb-1bd1-4fae-8848-46c2b491b08d, dataset_name: DatasetName { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }, kind: Cockroach }, responder: ... }
10452024-11-04T23:53:47.885ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 42f8c353-ecd2-4437-b12a-b408f08684c2, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10462024-11-04T23:53:47.885ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 42f8c353-ecd2-4437-b12a-b408f08684c2, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10472024-11-04T23:53:47.905ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2f29cbb2-451f-4975-a1c9-03364380c77e, dataset_name: DatasetName { pool_name: ZpoolName { id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10482024-11-04T23:53:47.905ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 2f29cbb2-451f-4975-a1c9-03364380c77e, dataset_name: DatasetName { pool_name: ZpoolName { id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10492024-11-04T23:53:47.923ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: da93f7c3-c04a-4ffb-994d-072f2e0b92e0, dataset_name: DatasetName { pool_name: ZpoolName { id: 6634f6ec-a171-4828-a984-8fb31f78439b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10502024-11-04T23:53:47.923ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: da93f7c3-c04a-4ffb-994d-072f2e0b92e0, dataset_name: DatasetName { pool_name: ZpoolName { id: 6634f6ec-a171-4828-a984-8fb31f78439b (zpool), kind: External }, kind: Cockroach }, responder: ... }
10512024-11-04T23:53:47.942ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d840e2fc-5a49-44c2-87c1-9190f4e47113, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10522024-11-04T23:53:47.942ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d840e2fc-5a49-44c2-87c1-9190f4e47113, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10532024-11-04T23:53:48.072ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295, dataset_name: DatasetName { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10542024-11-04T23:53:48.072ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295, dataset_name: DatasetName { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10552024-11-04T23:53:48.198ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 015507f2-2134-4114-90c1-5f26064ff0df, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:451
10562024-11-04T23:53:48.198ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 015507f2-2134-4114-90c1-5f26064ff0df, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10572024-11-04T23:53:48.334ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f13d593d-030a-434d-a7a2-8524a3d27d51, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10582024-11-04T23:53:48.334ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: f13d593d-030a-434d-a7a2-8524a3d27d51, dataset_name: DatasetName { pool_name: ZpoolName { id: a7cbccab-0e4b-441b-8c32-0d4fd283b1f2 (zpool), kind: External }, kind: Crucible }, responder: ... }
10592024-11-04T23:53:48.437ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5, dataset_name: DatasetName { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10602024-11-04T23:53:48.437ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5, dataset_name: DatasetName { pool_name: ZpoolName { id: b5c4456c-1550-488e-a3c6-7a939b550b2b (zpool), kind: External }, kind: Crucible }, responder: ... }
10612024-11-04T23:53:48.549ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8c826fff-76ef-40ff-bc7e-e67b6d59e7d7, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10622024-11-04T23:53:48.549ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8c826fff-76ef-40ff-bc7e-e67b6d59e7d7, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c7bfacc-ee49-4b61-8144-c219a6f7eec1 (zpool), kind: External }, kind: Crucible }, responder: ... }
10632024-11-04T23:53:48.683ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78, dataset_name: DatasetName { pool_name: ZpoolName { id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10642024-11-04T23:53:48.683ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78, dataset_name: DatasetName { pool_name: ZpoolName { id: 3f4115a5-5de9-472a-ac27-660d79d3d1f7 (zpool), kind: External }, kind: Crucible }, responder: ... }
10652024-11-04T23:53:48.823ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cadbf9c6-7b34-4140-87d4-d298bb7d7fa4, dataset_name: DatasetName { pool_name: ZpoolName { id: 6634f6ec-a171-4828-a984-8fb31f78439b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10662024-11-04T23:53:48.823ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: cadbf9c6-7b34-4140-87d4-d298bb7d7fa4, dataset_name: DatasetName { pool_name: ZpoolName { id: 6634f6ec-a171-4828-a984-8fb31f78439b (zpool), kind: External }, kind: Crucible }, responder: ... }
10672024-11-04T23:53:48.939ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5564e11e-42ce-47de-aa70-90efe5750a93, dataset_name: DatasetName { pool_name: ZpoolName { id: aeae1e8c-da96-4cb8-a754-49b610133fd0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10682024-11-04T23:53:48.939ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 5564e11e-42ce-47de-aa70-90efe5750a93, dataset_name: DatasetName { pool_name: ZpoolName { id: aeae1e8c-da96-4cb8-a754-49b610133fd0 (zpool), kind: External }, kind: Crucible }, responder: ... }
10692024-11-04T23:53:49.027ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b3584514-7414-4d9d-8b44-bc78badc90df, dataset_name: DatasetName { pool_name: ZpoolName { id: ffa9fae5-11fd-49c9-ab91-90383e170a6c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10702024-11-04T23:53:49.027ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: b3584514-7414-4d9d-8b44-bc78badc90df, dataset_name: DatasetName { pool_name: ZpoolName { id: ffa9fae5-11fd-49c9-ab91-90383e170a6c (zpool), kind: External }, kind: Crucible }, responder: ... }
10712024-11-04T23:53:49.124ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: aae166ac-eeb9-49fd-8c35-949be561350c, dataset_name: DatasetName { pool_name: ZpoolName { id: 7bc77ba6-9886-4954-bc34-bc232ce1413f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10722024-11-04T23:53:49.124ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: aae166ac-eeb9-49fd-8c35-949be561350c, dataset_name: DatasetName { pool_name: ZpoolName { id: 7bc77ba6-9886-4954-bc34-bc232ce1413f (zpool), kind: External }, kind: Crucible }, responder: ... }
10732024-11-04T23:53:49.203ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3063cc09-aec0-4a7e-9f10-942e2ac49629, dataset_name: DatasetName { pool_name: ZpoolName { id: 7449cf8d-6d8a-4759-b257-0067c28bc087 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10742024-11-04T23:53:49.203ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 3063cc09-aec0-4a7e-9f10-942e2ac49629, dataset_name: DatasetName { pool_name: ZpoolName { id: 7449cf8d-6d8a-4759-b257-0067c28bc087 (zpool), kind: External }, kind: Crucible }, responder: ... }
10752024-11-04T23:53:49.287ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10762024-11-04T23:53:49.287ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/omicron-zones.json file = common/src/ledger.rs:177
10772024-11-04T23:53:49.287ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/omicron-zones.json file = common/src/ledger.rs:177
10782024-11-04T23:53:49.287ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10792024-11-04T23:53:49.406ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10802024-11-04T23:53:49.408ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10812024-11-04T23:53:49.434ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10822024-11-04T23:53:49.434ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10832024-11-04T23:53:49.434ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10842024-11-04T23:53:49.434ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10852024-11-04T23:53:49.434ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10862024-11-04T23:53:49.468ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10872024-11-04T23:53:49.468ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10882024-11-04T23:53:49.468ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10892024-11-04T23:53:49.479ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10902024-11-04T23:53:49.666ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10912024-11-04T23:53:49.666ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10922024-11-04T23:53:49.666ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10932024-11-04T23:53:49.666ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10942024-11-04T23:53:49.666ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10952024-11-04T23:53:49.666ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10962024-11-04T23:53:49.666ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10972024-11-04T23:53:49.666ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10982024-11-04T23:53:49.666ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df file = illumos-utils/src/zone.rs:325
10992024-11-04T23:53:49.670ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e file = illumos-utils/src/zone.rs:325
11002024-11-04T23:53:49.674ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5 file = illumos-utils/src/zone.rs:325
11012024-11-04T23:53:49.679ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df file = illumos-utils/src/zone.rs:325
11022024-11-04T23:53:49.684ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7 file = illumos-utils/src/zone.rs:325
11032024-11-04T23:53:49.689ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78 file = illumos-utils/src/zone.rs:325
11042024-11-04T23:53:49.694ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93 file = illumos-utils/src/zone.rs:325
11052024-11-04T23:53:49.833ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df file = illumos-utils/src/zone.rs:363
11062024-11-04T23:53:49.838ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e file = illumos-utils/src/zone.rs:363
11072024-11-04T23:53:49.842ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5 file = illumos-utils/src/zone.rs:363
11082024-11-04T23:53:49.846ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df file = illumos-utils/src/zone.rs:363
11092024-11-04T23:53:49.850ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7 file = illumos-utils/src/zone.rs:363
11102024-11-04T23:53:49.855ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78 file = illumos-utils/src/zone.rs:363
11112024-11-04T23:53:49.860ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93 file = illumos-utils/src/zone.rs:363
11122024-11-04T23:53:49.865ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c file = illumos-utils/src/zone.rs:325
11132024-11-04T23:53:49.869ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4 file = illumos-utils/src/zone.rs:325
11142024-11-04T23:53:49.874ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5 file = illumos-utils/src/zone.rs:325
11152024-11-04T23:53:49.880ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2 file = illumos-utils/src/zone.rs:325
11162024-11-04T23:53:49.884ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18 file = illumos-utils/src/zone.rs:325
11172024-11-04T23:53:49.889ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51 file = illumos-utils/src/zone.rs:325
11182024-11-04T23:53:49.895ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629 file = illumos-utils/src/zone.rs:325
11192024-11-04T23:53:49.901ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c file = illumos-utils/src/zone.rs:363
11202024-11-04T23:53:49.908ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4 file = illumos-utils/src/zone.rs:363
11212024-11-04T23:53:49.913ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5 file = illumos-utils/src/zone.rs:363
11222024-11-04T23:53:49.918ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2 file = illumos-utils/src/zone.rs:363
11232024-11-04T23:53:49.923ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18 file = illumos-utils/src/zone.rs:363
11242024-11-04T23:53:49.927ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51 file = illumos-utils/src/zone.rs:363
11252024-11-04T23:53:49.931ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629 file = illumos-utils/src/zone.rs:363
11262024-11-04T23:53:49.969ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11272024-11-04T23:53:50.003ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11282024-11-04T23:53:50.036ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11292024-11-04T23:53:50.071ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11302024-11-04T23:53:50.125ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11312024-11-04T23:53:50.126ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11322024-11-04T23:53:50.127ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11332024-11-04T23:53:50.173ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 248, 237]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11342024-11-04T23:53:50.173ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = external_dns
11352024-11-04T23:53:50.174ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11362024-11-04T23:53:50.174ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11372024-11-04T23:53:50.228ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 136, 205]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11382024-11-04T23:53:50.228ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
11392024-11-04T23:53:50.229ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11402024-11-04T23:53:50.229ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11412024-11-04T23:53:50.280ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 156, 18]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11422024-11-04T23:53:50.280ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
11432024-11-04T23:53:50.282ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11442024-11-04T23:53:50.282ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11452024-11-04T23:53:50.337ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 154, 186]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11462024-11-04T23:53:50.337ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = external_dns
11472024-11-04T23:53:50.340ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11482024-11-04T23:53:50.340ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11492024-11-04T23:53:50.394ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 202, 127]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11502024-11-04T23:53:50.394ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
11512024-11-04T23:53:50.395ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11522024-11-04T23:53:50.395ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11532024-11-04T23:53:50.395ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11542024-11-04T23:53:50.395ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11552024-11-04T23:53:50.395ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11562024-11-04T23:53:50.395ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11572024-11-04T23:53:50.395ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11582024-11-04T23:53:50.395ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11592024-11-04T23:53:50.396ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
11602024-11-04T23:53:50.398ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11612024-11-04T23:53:50.491ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11622024-11-04T23:53:50.495ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11632024-11-04T23:53:50.495ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11642024-11-04T23:53:50.498ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11652024-11-04T23:53:50.498ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11662024-11-04T23:53:50.502ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11672024-11-04T23:53:50.502ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11682024-11-04T23:53:50.502ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11692024-11-04T23:53:50.638ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
11702024-11-04T23:53:50.642ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11712024-11-04T23:53:50.642ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113 file = illumos-utils/src/zone.rs:325
11722024-11-04T23:53:50.653ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd file = illumos-utils/src/zone.rs:325
11732024-11-04T23:53:50.669ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7 file = illumos-utils/src/zone.rs:325
11742024-11-04T23:53:50.681ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295 file = illumos-utils/src/zone.rs:325
11752024-11-04T23:53:50.742ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113 file = illumos-utils/src/zone.rs:363
11762024-11-04T23:53:50.763ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd file = illumos-utils/src/zone.rs:363
11772024-11-04T23:53:50.788ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7 file = illumos-utils/src/zone.rs:363
11782024-11-04T23:53:50.815ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295 file = illumos-utils/src/zone.rs:363
11792024-11-04T23:53:50.837ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284 file = illumos-utils/src/zone.rs:325
11802024-11-04T23:53:50.884ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284 file = illumos-utils/src/zone.rs:363
11812024-11-04T23:53:52.366ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_aeae1e8c-da96-4cb8-a754-49b610133fd0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e1646924-9844-4ad6-9837-f9a898346d59'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11822024-11-04T23:53:52.366ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
11832024-11-04T23:53:52.369ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8c7bfacc-ee49-4b61-8144-c219a6f7eec1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='94227241-647a-4bfc-96cd-228796340105'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11842024-11-04T23:53:52.369ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3f4115a5-5de9-472a-ac27-660d79d3d1f7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='637ad081-c50a-4158-9253-90085321168b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11852024-11-04T23:53:52.369ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
11862024-11-04T23:53:52.375ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
11872024-11-04T23:53:52.380ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6634f6ec-a171-4828-a984-8fb31f78439b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='edf32d2c-4601-48c8-b792-ba306d64dd28'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11882024-11-04T23:53:52.381ZINFOSledAgent (ServiceManager): Booting oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
11892024-11-04T23:53:52.437ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b5c4456c-1550-488e-a3c6-7a939b550b2b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='6054ae37-598e-4661-9139-316c23a784a4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11902024-11-04T23:53:52.437ZINFOSledAgent (ServiceManager): Booting oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
11912024-11-04T23:53:52.444ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11922024-11-04T23:53:52.444ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11932024-11-04T23:53:52.444ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
11942024-11-04T23:53:52.450ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
11952024-11-04T23:53:52.498ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7bc77ba6-9886-4954-bc34-bc232ce1413f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f5048028-a40d-40ba-97f0-a816312e1401'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11962024-11-04T23:53:52.498ZINFOSledAgent (ServiceManager): Booting oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
11972024-11-04T23:53:52.563ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ffa9fae5-11fd-49c9-ab91-90383e170a6c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='93a12fc5-e2b5-4945-9e9a-45a5956b0e23'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11982024-11-04T23:53:52.563ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
11992024-11-04T23:53:52.571ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7449cf8d-6d8a-4759-b257-0067c28bc087/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='302ebb96-0313-45f6-b5ad-d1e6d73c21eb'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12002024-11-04T23:53:52.571ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
12012024-11-04T23:53:52.602ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='936f0bc7-d5c8-4edc-b21c-cc06e01960a5'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12022024-11-04T23:53:52.603ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
12032024-11-04T23:53:52.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 30.630924ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
12042024-11-04T23:53:52.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 53.284415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
12052024-11-04T23:53:52.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 45.399705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
12062024-11-04T23:53:52.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 25.30488ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
12072024-11-04T23:53:52.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 45.558776ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
12082024-11-04T23:53:52.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 39.887077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
12092024-11-04T23:53:52.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 29.485142ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
12102024-11-04T23:53:52.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 67.862856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
12112024-11-04T23:53:52.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 58.460848ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
12122024-11-04T23:53:52.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 136.534847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
12132024-11-04T23:53:53.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 74.84658ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
12142024-11-04T23:53:53.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 63.086014ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
12152024-11-04T23:53:53.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 57.213983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
12162024-11-04T23:53:53.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 53.116984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
12172024-11-04T23:53:53.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 81.245493ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
12182024-11-04T23:53:53.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 90.71319ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
12192024-11-04T23:53:53.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 68.625613ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
12202024-11-04T23:53:53.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 297.70586ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
12212024-11-04T23:53:54.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 104.478289ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
12222024-11-04T23:53:54.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 75.003516ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
12232024-11-04T23:53:54.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 137.047104ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
12242024-11-04T23:53:54.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 90.928943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
12252024-11-04T23:53:54.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 103.344761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
12262024-11-04T23:53:55.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 163.438961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
12272024-11-04T23:53:55.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 175.666783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
12282024-11-04T23:53:55.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 130.012597ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
12292024-11-04T23:53:55.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 257.681864ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
12302024-11-04T23:53:55.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 139.008255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
12312024-11-04T23:53:55.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 591.377454ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
12322024-11-04T23:53:55.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 220.295092ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
12332024-11-04T23:53:55.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 245.7886ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
12342024-11-04T23:53:55.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 295.397368ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
12352024-11-04T23:53:55.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 227.10104ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
12362024-11-04T23:53:55.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 291.053828ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
12372024-11-04T23:53:55.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 451.368708ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
12382024-11-04T23:53:55.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 370.2307ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
12392024-11-04T23:53:55.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 591.39526ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
12402024-11-04T23:53:55.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 213.244228ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
12412024-11-04T23:53:55.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 411.74692ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
12422024-11-04T23:53:55.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 251.522138ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
12432024-11-04T23:53:55.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 454.957015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
12442024-11-04T23:53:55.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 556.41992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
12452024-11-04T23:53:55.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 462.031264ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
12462024-11-04T23:53:55.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 1.083644735s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
12472024-11-04T23:53:55.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 431.627368ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
12482024-11-04T23:53:55.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 660.095931ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
12492024-11-04T23:53:55.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 425.893547ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
12502024-11-04T23:53:55.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 1.011843162s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
12512024-11-04T23:53:55.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 964.344756ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
12522024-11-04T23:53:55.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 1.175400777s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
12532024-11-04T23:53:55.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 512.958171ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
12542024-11-04T23:53:55.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 533.188167ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
12552024-11-04T23:53:56.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 412.273555ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
12562024-11-04T23:53:56.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 431.030941ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
12572024-11-04T23:53:56.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 770.943683ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
12582024-11-04T23:53:56.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 710.256922ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
12592024-11-04T23:53:56.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 615.79447ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
12602024-11-04T23:53:56.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 657.124002ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
12612024-11-04T23:53:56.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 1.345709207s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
12622024-11-04T23:53:56.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 501.107767ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
12632024-11-04T23:53:56.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 942.894336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
12642024-11-04T23:53:56.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 695.859533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
12652024-11-04T23:53:56.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 1.077397188s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
12662024-11-04T23:53:56.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 512.293831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
12672024-11-04T23:53:56.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 634.013113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
12682024-11-04T23:53:56.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 1.296992292s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
12692024-11-04T23:53:56.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 973.438848ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
12702024-11-04T23:53:56.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 733.384114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
12712024-11-04T23:53:57.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 910.673765ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
12722024-11-04T23:53:57.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 995.589938ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
12732024-11-04T23:53:57.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 1.142604203s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
12742024-11-04T23:53:57.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 1.058988973s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
12752024-11-04T23:53:57.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 1.245131083s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
12762024-11-04T23:53:57.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 675.45353ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
12772024-11-04T23:53:57.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 1.261858764s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
12782024-11-04T23:53:57.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 1.242854717s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
12792024-11-04T23:53:57.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 1.338290228s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
12802024-11-04T23:53:57.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 1.201937768s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
12812024-11-04T23:53:57.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 572.54539ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
12822024-11-04T23:53:58.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 1.004325238s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
12832024-11-04T23:53:58.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 1.037108944s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
12842024-11-04T23:53:58.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 988.293364ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
12852024-11-04T23:53:58.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 800.776461ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
12862024-11-04T23:53:58.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 1.426622997s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
12872024-11-04T23:53:58.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 1.274318082s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
12882024-11-04T23:53:58.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 1.071977788s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
12892024-11-04T23:53:59.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 1.164060402s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
12902024-11-04T23:53:59.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 1.14815593s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
12912024-11-04T23:53:59.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 755.265249ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
12922024-11-04T23:53:59.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 1.085060063s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
12932024-11-04T23:53:59.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 1.050061044s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
12942024-11-04T23:53:59.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 904.966937ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
12952024-11-04T23:53:59.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 827.829939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
12962024-11-04T23:53:59.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 1.466580731s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
12972024-11-04T23:53:59.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 540.051277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
12982024-11-04T23:53:59.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 1.03572465s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
12992024-11-04T23:53:59.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 925.1795ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
13002024-11-04T23:53:59.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 1.207922529s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
13012024-11-04T23:54:00.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 675.806985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
13022024-11-04T23:54:00.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 1.345850856s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
13032024-11-04T23:54:00.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 771.178631ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
13042024-11-04T23:54:00.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 1.418543685s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
13052024-11-04T23:54:00.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 951.563058ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
13062024-11-04T23:54:00.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 1.204533495s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
13072024-11-04T23:54:00.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 1.286280651s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
13082024-11-04T23:54:00.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 1.080806957s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
13092024-11-04T23:54:00.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 1.258173904s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
13102024-11-04T23:54:00.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 1.033402608s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
13112024-11-04T23:54:00.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 1.025931735s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
13122024-11-04T23:54:00.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 1.381524822s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
13132024-11-04T23:54:01.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 1.19292313s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
13142024-11-04T23:54:01.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 512.087847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
13152024-11-04T23:54:01.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 1.285162488s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
13162024-11-04T23:54:01.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 996.834558ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
13172024-11-04T23:54:01.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 943.560617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
13182024-11-04T23:54:01.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 674.900985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
13192024-11-04T23:54:01.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 1.284877945s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
13202024-11-04T23:54:01.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 1.29505778s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
13212024-11-04T23:54:01.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 918.01401ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
13222024-11-04T23:54:01.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 520.085108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
13232024-11-04T23:54:02.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 1.104288787s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
13242024-11-04T23:54:02.269ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13252024-11-04T23:54:02.282ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
13262024-11-04T23:54:02.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 1.006656897s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
13272024-11-04T23:54:02.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 1.032863942s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
13282024-11-04T23:54:02.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 1.088156096s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
13292024-11-04T23:54:02.468ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a7cbccab-0e4b-441b-8c32-0d4fd283b1f2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2a00e215-d672-44ed-b45b-c598600abd57'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13302024-11-04T23:54:02.468ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
13312024-11-04T23:54:02.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 705.628593ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
13322024-11-04T23:54:02.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 784.880933ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
13332024-11-04T23:54:02.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 25.651088ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
13342024-11-04T23:54:02.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 670.873949ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
13352024-11-04T23:54:02.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 147.033888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
13362024-11-04T23:54:02.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 38.853359ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
13372024-11-04T23:54:02.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 1.325773577s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
13382024-11-04T23:54:02.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 122.924888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
13392024-11-04T23:54:02.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 230.877984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
13402024-11-04T23:54:02.857ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 46.373865837s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
13412024-11-04T23:54:02.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 544.32845ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
13422024-11-04T23:54:02.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 178.411992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
13432024-11-04T23:54:03.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 237.739904ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
13442024-11-04T23:54:03.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 1.091267187s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
13452024-11-04T23:54:03.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 264.423709ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
13462024-11-04T23:54:03.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 1.26749341s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
13472024-11-04T23:54:03.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 1.135760041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
13482024-11-04T23:54:03.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 1.18645217s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
13492024-11-04T23:54:03.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 932.062642ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
13502024-11-04T23:54:03.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 1.42634347s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
13512024-11-04T23:54:03.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 826.484435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
13522024-11-04T23:54:03.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 901.286005ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
13532024-11-04T23:54:03.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 653.344323ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
13542024-11-04T23:54:03.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 897.228848ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
13552024-11-04T23:54:03.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 890.128942ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
13562024-11-04T23:54:03.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 1.23405956s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
13572024-11-04T23:54:04.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 1.236283472s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
13582024-11-04T23:54:04.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 1.055287048s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
13592024-11-04T23:54:04.156ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13602024-11-04T23:54:04.156ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
13612024-11-04T23:54:04.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 982.002713ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
13622024-11-04T23:54:04.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 1.394316082s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
13632024-11-04T23:54:04.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 794.060944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
13642024-11-04T23:54:04.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 1.159730768s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
13652024-11-04T23:54:04.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 1.483338011s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
13662024-11-04T23:54:04.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 952.438861ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
13672024-11-04T23:54:04.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 1.141814933s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
13682024-11-04T23:54:04.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 1.231906048s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
13692024-11-04T23:54:04.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 1.195067142s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
13702024-11-04T23:54:04.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 64.314899ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
13712024-11-04T23:54:04.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 142.453142ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
13722024-11-04T23:54:04.616ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13732024-11-04T23:54:04.616ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
13742024-11-04T23:54:04.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 1.038985351s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
13752024-11-04T23:54:04.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 264.868103ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
13762024-11-04T23:54:04.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 1.258061904s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
13772024-11-04T23:54:05.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 426.11275ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
13782024-11-04T23:54:05.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 26.412957ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
13792024-11-04T23:54:05.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 1.287814678s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
13802024-11-04T23:54:05.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 116.749924ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
13812024-11-04T23:54:05.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 921.335872ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
13822024-11-04T23:54:05.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 736.899631ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
13832024-11-04T23:54:05.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 663.064886ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
13842024-11-04T23:54:05.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 567.914448ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
13852024-11-04T23:54:05.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 208.573978ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
13862024-11-04T23:54:05.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 1.076481392s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
13872024-11-04T23:54:05.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 710.163836ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
13882024-11-04T23:54:05.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 1.085938044s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
13892024-11-04T23:54:05.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 305.126101ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
13902024-11-04T23:54:05.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 1.485824854s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
13912024-11-04T23:54:05.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 689.210937ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
13922024-11-04T23:54:05.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 877.073182ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
13932024-11-04T23:54:05.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 1.111071309s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
13942024-11-04T23:54:05.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 820.269136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
13952024-11-04T23:54:05.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 802.623494ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
13962024-11-04T23:54:05.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 1.365713004s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
13972024-11-04T23:54:06.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 895.606709ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
13982024-11-04T23:54:06.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 1.098390231s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
13992024-11-04T23:54:06.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 1.257692287s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
14002024-11-04T23:54:06.178ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14012024-11-04T23:54:06.178ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14022024-11-04T23:54:06.178ZINFOSledAgent (ServiceManager): Booting oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
14032024-11-04T23:54:06.185ZINFOSledAgent (ServiceManager): Booting oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
14042024-11-04T23:54:06.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 1.230563488s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
14052024-11-04T23:54:06.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 567.362092ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
14062024-11-04T23:54:06.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 886.050446ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
14072024-11-04T23:54:06.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 70.248799ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
14082024-11-04T23:54:06.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 65.064932ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
14092024-11-04T23:54:06.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 1.223553279s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
14102024-11-04T23:54:06.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 70.395183ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
14112024-11-04T23:54:06.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 611.056771ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
14122024-11-04T23:54:06.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 59.003626ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
14132024-11-04T23:54:06.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 110.41781ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
14142024-11-04T23:54:06.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 735.120297ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
14152024-11-04T23:54:06.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 960.946478ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
14162024-11-04T23:54:06.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 1.426965396s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
14172024-11-04T23:54:06.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 211.13117ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
14182024-11-04T23:54:06.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 992.532795ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
14192024-11-04T23:54:06.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 372.781633ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
14202024-11-04T23:54:06.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 1.382401822s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
14212024-11-04T23:54:06.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 1.084263136s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
14222024-11-04T23:54:07.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 1.457623369s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
14232024-11-04T23:54:07.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 516.321468ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
14242024-11-04T23:54:07.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 1.022244288s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
14252024-11-04T23:54:07.188ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14262024-11-04T23:54:07.188ZINFOSledAgent (ServiceManager): Booting oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
14272024-11-04T23:54:07.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 1.148407577s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
14282024-11-04T23:54:07.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 666.667735ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
14292024-11-04T23:54:07.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 880.546525ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
14302024-11-04T23:54:07.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 1.109359609s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
14312024-11-04T23:54:07.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 1.12202106s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
14322024-11-04T23:54:07.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 37.885354ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
14332024-11-04T23:54:07.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 1.354664006s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
14342024-11-04T23:54:07.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 110.120776ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
14352024-11-04T23:54:07.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 833.929181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
14362024-11-04T23:54:07.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 1.165445426s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
14372024-11-04T23:54:07.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 196.124548ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
14382024-11-04T23:54:07.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 1.014687278s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
14392024-11-04T23:54:07.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 927.252186ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
14402024-11-04T23:54:07.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 929.110062ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
14412024-11-04T23:54:07.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 423.367643ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
14422024-11-04T23:54:07.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 1.487669557s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
14432024-11-04T23:54:07.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 876.611473ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
14442024-11-04T23:54:08.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 764.493133ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
14452024-11-04T23:54:08.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 584.151442ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
14462024-11-04T23:54:08.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 1.266818298s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
14472024-11-04T23:54:08.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 650.087229ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
14482024-11-04T23:54:08.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 1.26840612s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
14492024-11-04T23:54:08.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 594.533828ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
14502024-11-04T23:54:08.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 979.829938ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
14512024-11-04T23:54:08.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 1.334060944s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
14522024-11-04T23:54:08.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 1.025540965s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
14532024-11-04T23:54:08.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 1.416296673s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
14542024-11-04T23:54:08.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 547.480022ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
14552024-11-04T23:54:08.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 534.239364ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
14562024-11-04T23:54:08.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 663.102328ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
14572024-11-04T23:54:08.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 881.856644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
14582024-11-04T23:54:08.683ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14592024-11-04T23:54:08.683ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
14602024-11-04T23:54:08.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 1.120392215s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
14612024-11-04T23:54:08.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 611.948896ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
14622024-11-04T23:54:08.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 837.845176ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
14632024-11-04T23:54:08.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 1.059325506s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
14642024-11-04T23:54:08.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 611.912ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
14652024-11-04T23:54:08.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 44.48669ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
14662024-11-04T23:54:08.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 774.243163ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
14672024-11-04T23:54:08.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 1.165109738s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
14682024-11-04T23:54:08.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 66.221953ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
14692024-11-04T23:54:08.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 255.430247ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
14702024-11-04T23:54:09.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 1.475398012s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
14712024-11-04T23:54:09.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 1.176507948s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
14722024-11-04T23:54:09.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 226.500583ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
14732024-11-04T23:54:09.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 1.17302858s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
14742024-11-04T23:54:09.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 526.469591ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
14752024-11-04T23:54:09.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 697.730714ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
14762024-11-04T23:54:09.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 1.367244096s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
14772024-11-04T23:54:09.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 541.869967ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
14782024-11-04T23:54:09.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 1.182107124s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
14792024-11-04T23:54:09.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 774.395069ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
14802024-11-04T23:54:09.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 661.945364ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
14812024-11-04T23:54:09.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 614.555782ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
14822024-11-04T23:54:09.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 531.924892ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
14832024-11-04T23:54:09.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 1.015603123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
14842024-11-04T23:54:09.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 818.981955ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
14852024-11-04T23:54:09.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 850.511014ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
14862024-11-04T23:54:09.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 1.458781384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
14872024-11-04T23:54:09.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 1.029832343s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
14882024-11-04T23:54:09.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 1.095476127s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
14892024-11-04T23:54:09.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 520.114351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
14902024-11-04T23:54:09.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 788.467384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
14912024-11-04T23:54:10.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 565.202282ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
14922024-11-04T23:54:10.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 1.04633083s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
14932024-11-04T23:54:10.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 1.157574363s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
14942024-11-04T23:54:10.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 945.59829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
14952024-11-04T23:54:10.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 1.233341601s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
14962024-11-04T23:54:10.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 1.238907728s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
14972024-11-04T23:54:10.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 1.280348325s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
14982024-11-04T23:54:10.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 1.349480282s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
14992024-11-04T23:54:10.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 950.016943ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
15002024-11-04T23:54:10.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 1.440504565s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
15012024-11-04T23:54:10.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 672.140216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
15022024-11-04T23:54:10.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 1.087371722s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
15032024-11-04T23:54:10.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 929.375874ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
15042024-11-04T23:54:10.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 1.058030539s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
15052024-11-04T23:54:10.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 1.395744195s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
15062024-11-04T23:54:10.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 707.63129ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
15072024-11-04T23:54:10.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 625.749269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
15082024-11-04T23:54:10.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 683.444244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
15092024-11-04T23:54:10.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 812.242805ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
15102024-11-04T23:54:11.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 1.054611649s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
15112024-11-04T23:54:11.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 542.292802ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
15122024-11-04T23:54:11.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 1.331582744s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
15132024-11-04T23:54:11.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 797.506797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
15142024-11-04T23:54:11.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 974.887356ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
15152024-11-04T23:54:11.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 1.302420782s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
15162024-11-04T23:54:11.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 1.104268388s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
15172024-11-04T23:54:11.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 768.118934ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
15182024-11-04T23:54:11.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 619.358247ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
15192024-11-04T23:54:11.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 1.39381082s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
15202024-11-04T23:54:11.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 1.207479789s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
15212024-11-04T23:54:11.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 1.397558412s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
15222024-11-04T23:54:11.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 1.38630598s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
15232024-11-04T23:54:11.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 760.169939ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
15242024-11-04T23:54:11.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 1.471136608s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
15252024-11-04T23:54:11.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 1.208686721s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
15262024-11-04T23:54:11.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 823.394968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
15272024-11-04T23:54:11.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 563.048429ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
15282024-11-04T23:54:11.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 759.229778ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
15292024-11-04T23:54:12.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 1.319518972s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
15302024-11-04T23:54:12.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 1.367752911s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
15312024-11-04T23:54:12.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 1.001554883s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
15322024-11-04T23:54:12.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 1.416719466s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
15332024-11-04T23:54:12.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 1.348192268s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
15342024-11-04T23:54:12.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 1.002531068s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
15352024-11-04T23:54:12.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 722.991076ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
15362024-11-04T23:54:12.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 1.446450126s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
15372024-11-04T23:54:12.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 1.231896778s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
15382024-11-04T23:54:12.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 528.367659ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
15392024-11-04T23:54:12.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 548.526692ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
15402024-11-04T23:54:12.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 886.318448ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
15412024-11-04T23:54:12.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 789.688912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
15422024-11-04T23:54:12.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 1.232345932s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
15432024-11-04T23:54:12.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 1.499024095s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
15442024-11-04T23:54:12.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 807.329335ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
15452024-11-04T23:54:13.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 906.41699ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
15462024-11-04T23:54:13.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 964.491687ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
15472024-11-04T23:54:13.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 1.045518051s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
15482024-11-04T23:54:13.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 831.109638ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
15492024-11-04T23:54:13.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 697.237988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
15502024-11-04T23:54:13.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 602.019738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
15512024-11-04T23:54:13.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 586.53943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
15522024-11-04T23:54:13.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 1.019947127s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
15532024-11-04T23:54:13.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 1.349386193s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
15542024-11-04T23:54:13.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 1.492104377s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
15552024-11-04T23:54:13.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 800.138091ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
15562024-11-04T23:54:13.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 1.42446739s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
15572024-11-04T23:54:13.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 637.931286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
15582024-11-04T23:54:13.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 1.06444722s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
15592024-11-04T23:54:13.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 1.492814263s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
15602024-11-04T23:54:13.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 696.834908ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
15612024-11-04T23:54:13.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 1.268762062s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
15622024-11-04T23:54:13.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 562.61838ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
15632024-11-04T23:54:13.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 1.145359782s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
15642024-11-04T23:54:13.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 599.262023ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
15652024-11-04T23:54:13.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 582.20129ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
15662024-11-04T23:54:13.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 504.445872ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
15672024-11-04T23:54:14.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 1.217645009s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
15682024-11-04T23:54:14.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 1.330359757s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
15692024-11-04T23:54:14.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 938.765213ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
15702024-11-04T23:54:14.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 772.930858ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
15712024-11-04T23:54:14.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 566.405794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
15722024-11-04T23:54:14.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 702.150619ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
15732024-11-04T23:54:14.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 740.659466ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
15742024-11-04T23:54:14.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 948.805318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
15752024-11-04T23:54:14.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 587.540396ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
15762024-11-04T23:54:14.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 687.21575ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
15772024-11-04T23:54:14.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 1.038647088s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
15782024-11-04T23:54:14.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 760.715279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
15792024-11-04T23:54:14.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 597.037771ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
15802024-11-04T23:54:14.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 590.016826ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
15812024-11-04T23:54:14.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 1.430835746s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
15822024-11-04T23:54:14.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 1.00326674s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
15832024-11-04T23:54:14.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 966.011973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
15842024-11-04T23:54:15.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 1.476418597s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
15852024-11-04T23:54:15.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 1.459451865s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
15862024-11-04T23:54:15.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 1.294306816s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
15872024-11-04T23:54:15.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 940.798737ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
15882024-11-04T23:54:15.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 1.013792549s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
15892024-11-04T23:54:15.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 1.363131322s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
15902024-11-04T23:54:15.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 667.400501ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
15912024-11-04T23:54:15.111ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45749
15922024-11-04T23:54:15.140ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 19357 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45749 req_id = c1227e5c-7a05-46e3-b276-9d00893df16a response_code = 200 uri = /baseboard
15932024-11-04T23:54:15.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 694.95453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
15942024-11-04T23:54:15.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 1.346473712s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
15952024-11-04T23:54:15.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 1.363498594s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
15962024-11-04T23:54:15.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 808.607482ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
15972024-11-04T23:54:15.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 1.415585501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
15982024-11-04T23:54:15.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 620.370819ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
15992024-11-04T23:54:15.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 979.447408ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
16002024-11-04T23:54:15.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 509.114418ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
16012024-11-04T23:54:15.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 778.417082ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
16022024-11-04T23:54:15.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 775.526916ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
16032024-11-04T23:54:15.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 539.17475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
16042024-11-04T23:54:15.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 1.313591812s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
16052024-11-04T23:54:15.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 1.128787843s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
16062024-11-04T23:54:15.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 840.178111ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
16072024-11-04T23:54:15.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 1.381552399s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
16082024-11-04T23:54:15.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 1.372723329s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
16092024-11-04T23:54:16.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 1.164740428s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
16102024-11-04T23:54:16.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 1.477263703s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
16112024-11-04T23:54:16.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 916.09135ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
16122024-11-04T23:54:16.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 1.38521819s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
16132024-11-04T23:54:16.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 971.417421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
16142024-11-04T23:54:16.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 995.811827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
16152024-11-04T23:54:16.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 842.169574ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
16162024-11-04T23:54:16.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 1.301587353s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
16172024-11-04T23:54:16.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 1.057468683s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
16182024-11-04T23:54:16.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 798.541672ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
16192024-11-04T23:54:16.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 706.106244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
16202024-11-04T23:54:16.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 1.329137901s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
16212024-11-04T23:54:16.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 1.282665754s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
16222024-11-04T23:54:16.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 581.610002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
16232024-11-04T23:54:16.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 1.328824332s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
16242024-11-04T23:54:17.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 528.144152ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
16252024-11-04T23:54:17.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 1.064788004s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
16262024-11-04T23:54:17.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 888.18456ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
16272024-11-04T23:54:17.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 597.912646ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
16282024-11-04T23:54:17.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 603.831734ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
16292024-11-04T23:54:17.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 514.526311ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
16302024-11-04T23:54:17.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 1.381058175s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
16312024-11-04T23:54:17.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 874.004997ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
16322024-11-04T23:54:17.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 849.147475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
16332024-11-04T23:54:17.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 926.615025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
16342024-11-04T23:54:17.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 765.260249ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
16352024-11-04T23:54:17.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 1.127585106s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
16362024-11-04T23:54:17.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 1.473544369s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
16372024-11-04T23:54:17.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 953.244106ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
16382024-11-04T23:54:17.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 1.488060417s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
16392024-11-04T23:54:17.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 1.35640702s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
16402024-11-04T23:54:17.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 1.201374094s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
16412024-11-04T23:54:17.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 1.126961764s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
16422024-11-04T23:54:17.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 887.625256ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
16432024-11-04T23:54:17.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 831.139632ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
16442024-11-04T23:54:17.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 1.319379213s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
16452024-11-04T23:54:17.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 640.806602ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
16462024-11-04T23:54:18.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 1.051163772s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
16472024-11-04T23:54:18.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 779.881215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
16482024-11-04T23:54:18.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 927.029222ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
16492024-11-04T23:54:18.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 1.212893354s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
16502024-11-04T23:54:18.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 1.423893312s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
16512024-11-04T23:54:18.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 779.319748ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
16522024-11-04T23:54:18.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 1.145205259s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
16532024-11-04T23:54:18.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 1.306167238s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
16542024-11-04T23:54:18.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 1.320664241s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
16552024-11-04T23:54:18.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 678.828427ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
16562024-11-04T23:54:18.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 1.192467809s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
16572024-11-04T23:54:18.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 1.269943075s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
16582024-11-04T23:54:18.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 974.880079ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
16592024-11-04T23:54:18.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 1.320272871s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
16602024-11-04T23:54:18.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 876.627815ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
16612024-11-04T23:54:18.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 730.696917ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
16622024-11-04T23:54:19.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18") failed: Property not found. retry in 602.515091ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
16632024-11-04T23:54:19.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 1.148971637s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
16642024-11-04T23:54:19.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 1.076567884s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
16652024-11-04T23:54:19.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 872.646598ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
16662024-11-04T23:54:19.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 1.25368162s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
16672024-11-04T23:54:19.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e") failed: Property not found. retry in 658.864676ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
16682024-11-04T23:54:19.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5") failed: Property not found. retry in 1.144513534s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
16692024-11-04T23:54:19.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 1.459870451s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
16702024-11-04T23:54:19.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2") failed: Property not found. retry in 603.416405ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
16712024-11-04T23:54:19.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5") failed: Property not found. retry in 1.297056004s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
16722024-11-04T23:54:19.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c") failed: Property not found. retry in 1.195880548s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
16732024-11-04T23:54:19.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629") failed: Property not found. retry in 1.170513909s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
16742024-11-04T23:54:19.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 926.802802ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
16752024-11-04T23:54:19.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51") failed: Property not found. retry in 1.01631866s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
16762024-11-04T23:54:19.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93") failed: Property not found. retry in 989.326705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
16772024-11-04T23:54:19.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 791.762937ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
16782024-11-04T23:54:19.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 1.08949155s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
16792024-11-04T23:54:20.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78") failed: Property not found. retry in 906.795102ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
16802024-11-04T23:54:20.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4") failed: Property not found. retry in 1.472116806s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
16812024-11-04T23:54:20.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 1.274997623s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
16822024-11-04T23:54:20.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 1.156085263s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
16832024-11-04T23:54:20.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7") failed: Property not found. retry in 756.711465ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
16842024-11-04T23:54:20.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df") failed: Property not found. retry in 1.182127355s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
16852024-11-04T23:54:20.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 1.367054629s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
16862024-11-04T23:54:20.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 951.624757ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
16872024-11-04T23:54:20.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 1.192521721s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
16882024-11-04T23:54:21.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 920.652325ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
16892024-11-04T23:54:21.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 1.184261534s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
16902024-11-04T23:54:21.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 1.263072873s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
16912024-11-04T23:54:21.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 964.282105ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
16922024-11-04T23:54:21.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 1.288405327s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
16932024-11-04T23:54:21.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 1.344002328s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
16942024-11-04T23:54:22.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 951.574762ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
16952024-11-04T23:54:22.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 673.128637ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
16962024-11-04T23:54:22.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 1.334105186s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
16972024-11-04T23:54:22.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 1.496947212s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
16982024-11-04T23:54:23.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 831.930574ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
16992024-11-04T23:54:23.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 553.845252ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
17002024-11-04T23:54:23.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 507.113439ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
17012024-11-04T23:54:23.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 1.112350493s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
17022024-11-04T23:54:23.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 679.678906ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
17032024-11-04T23:54:23.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 723.515523ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
17042024-11-04T23:54:23.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 710.547253ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
17052024-11-04T23:54:24.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 512.97455ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
17062024-11-04T23:54:24.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113") failed: Property not found. retry in 1.41458947s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
17072024-11-04T23:54:24.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7") failed: Property not found. retry in 1.023505667s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
17082024-11-04T23:54:24.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284") failed: Property not found. retry in 964.079841ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
17092024-11-04T23:54:24.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df") failed: Property not found. retry in 1.009651216s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
17102024-11-04T23:54:24.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd") failed: Property not found. retry in 1.212053692s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
17112024-11-04T23:54:24.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 500.249424ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
17122024-11-04T23:54:25.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295") failed: Property not found. retry in 1.198853754s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
17132024-11-04T23:54:26.372ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_external_dns_d840e2fc-5a49-44c2-87c1-9190f4e47113
17142024-11-04T23:54:26.372ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd
17152024-11-04T23:54:26.372ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_clickhouse_015507f2-2134-4114-90c1-5f26064ff0df
17162024-11-04T23:54:26.372ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_df6c6890-893f-4aa0-ae25-285394f5f40e
17172024-11-04T23:54:26.372ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_oximeter_936f0bc7-d5c8-4edc-b21c-cc06e01960a5
17182024-11-04T23:54:26.372ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_b3584514-7414-4d9d-8b44-bc78badc90df
17192024-11-04T23:54:26.373ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_96aa1415-4c39-4ede-a09d-b8326a8455f7
17202024-11-04T23:54:26.373ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_8c826fff-76ef-40ff-bc7e-e67b6d59e7d7
17212024-11-04T23:54:26.373ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_c5eefeac-fa39-4f8a-93b5-ad0efb6d0d78
17222024-11-04T23:54:26.373ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_external_dns_5f4c9dd5-dad6-4fc2-ba58-b064adbea295
17232024-11-04T23:54:26.373ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_5564e11e-42ce-47de-aa70-90efe5750a93
17242024-11-04T23:54:26.373ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_aae166ac-eeb9-49fd-8c35-949be561350c
17252024-11-04T23:54:26.373ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_cadbf9c6-7b34-4140-87d4-d298bb7d7fa4
17262024-11-04T23:54:26.373ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_537f08c4-5c8e-4ef0-9b22-1e4f5f7ef0f5
17272024-11-04T23:54:26.373ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_103f312a-a7ef-4d88-a957-51e81c91d2b2
17282024-11-04T23:54:26.373ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_b930d7eb-6301-4cf2-93ec-040c1daafc18
17292024-11-04T23:54:26.373ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_f13d593d-030a-434d-a7a2-8524a3d27d51
17302024-11-04T23:54:26.373ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_3063cc09-aec0-4a7e-9f10-942e2ac49629
17312024-11-04T23:54:26.373ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_2bc59dd6-be0a-4755-adc1-2be053a1e284
17322024-11-04T23:54:26.420ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17332024-11-04T23:54:26.519ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17342024-11-04T23:54:26.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38776766 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53678 req_id = 597999c1-3c80-4b00-a73e-7763c3172dd3 response_code = 204 uri = /omicron-zones
17352024-11-04T23:54:26.632ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1331
17362024-11-04T23:54:26.633ZINFOSledAgent (RSS): Writing ledger to /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17372024-11-04T23:54:26.633ZINFOSledAgent (RSS): Writing ledger to /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17382024-11-04T23:54:26.637ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:708
17392024-11-04T23:54:26.638ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:720
17402024-11-04T23:54:26.732ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:896
17412024-11-04T23:54:26.744ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17422024-11-04T23:54:26.844ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17432024-11-04T23:54:26.992ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17442024-11-04T23:54:27.129ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17452024-11-04T23:54:27.198ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/nexus.rs:527 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17462024-11-04T23:54:27.388ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17472024-11-04T23:54:27.665ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17482024-11-04T23:54:27.821ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/nexus.rs:527 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17492024-11-04T23:54:27.881ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17502024-11-04T23:54:28.207ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/probe_manager.rs:231 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17512024-11-04T23:54:28.234ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17522024-11-04T23:54:28.676ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17532024-11-04T23:54:29.115ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17542024-11-04T23:54:29.210ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/probe_manager.rs:231 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17552024-11-04T23:54:29.783ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/nexus.rs:527 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17562024-11-04T23:54:29.795ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17572024-11-04T23:54:30.216ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/probe_manager.rs:231 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17582024-11-04T23:54:30.660ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17592024-11-04T23:54:31.219ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/probe_manager.rs:231 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17602024-11-04T23:54:31.654ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17612024-11-04T23:54:31.782ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/nexus.rs:527 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17622024-11-04T23:54:32.211ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17632024-11-04T23:54:32.220ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/probe_manager.rs:231 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17642024-11-04T23:54:33.223ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/probe_manager.rs:231 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17652024-11-04T23:54:33.710ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17662024-11-04T23:54:33.782ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/nexus.rs:527 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17672024-11-04T23:54:34.224ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/probe_manager.rs:231 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17682024-11-04T23:54:34.519ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17692024-11-04T23:54:35.227ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/probe_manager.rs:231 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17702024-11-04T23:54:35.690ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17712024-11-04T23:54:35.782ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/nexus.rs:527 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17722024-11-04T23:54:36.229ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/probe_manager.rs:231 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17732024-11-04T23:54:36.731ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8c1d2eb7-1489-42d7-9ade-7cb4bea90783/initialization-complete) file = sled-agent/src/rack_setup/service.rs:958
17742024-11-04T23:54:37.231ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/probe_manager.rs:231 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17752024-11-04T23:54:37.783ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/nexus.rs:527 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17762024-11-04T23:54:38.233ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29) file = sled-agent/src/probe_manager.rs:231 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17772024-11-04T23:54:40.398ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "698e1b01-e478-4b8d-9ae0-cca80e0a303f", "content-length": "173", "date": "Mon, 04 Nov 2024 23:54:40 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"8c1d2eb7-1489-42d7-9ade-7cb4bea90783\"", request_id: "698e1b01-e478-4b8d-9ae0-cca80e0a303f" } file = sled-agent/src/rack_setup/service.rs:958
17782024-11-04T23:54:41.962ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
17792024-11-04T23:54:42.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34353
17802024-11-04T23:54:42.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1612 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34353 req_id = 5c34533b-7065-4eea-8a8f-c98acfc50f9b response_code = 200 uri = /vpc-routes
17812024-11-04T23:54:42.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39658
17822024-11-04T23:54:42.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39658 req_id = 5ae95bd3-3558-43bc-a4c6-cdd14914127b response_code = 200 uri = /vpc-routes
17832024-11-04T23:54:42.608ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
17842024-11-04T23:54:42.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 832 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34353 req_id = fb315e4f-559e-4d36-abef-8bbfa8d1f3b8 response_code = 204 uri = /eip-gateways
17852024-11-04T23:54:42.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52571
17862024-11-04T23:54:42.634ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
17872024-11-04T23:54:42.634ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
17882024-11-04T23:54:42.635ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/omicron-zones.json file = common/src/ledger.rs:177
17892024-11-04T23:54:42.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48938
17902024-11-04T23:54:42.636ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
17912024-11-04T23:54:42.639ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/omicron-zones.json file = common/src/ledger.rs:177
17922024-11-04T23:54:42.649ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
17932024-11-04T23:54:42.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39658 req_id = 51927cb8-604a-4294-9c60-f34f9ae81a3c response_code = 204 uri = /eip-gateways
17942024-11-04T23:54:42.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54447
17952024-11-04T23:54:42.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54447 req_id = 1e1b8dfe-da7c-44fc-9bfe-87d549661be9 response_code = 200 uri = /vpc-routes
17962024-11-04T23:54:42.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47195
17972024-11-04T23:54:42.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47195 req_id = 5399ac14-bdf3-4e7d-930a-45eb4111dc18 response_code = 200 uri = /v2p
17982024-11-04T23:54:42.742ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
17992024-11-04T23:54:42.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 657 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54447 req_id = 7a0741dd-452a-4de7-a47a-3d9b63c8dffe response_code = 204 uri = /eip-gateways
18002024-11-04T23:54:42.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45619
18012024-11-04T23:54:42.772ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
18022024-11-04T23:54:42.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58514
18032024-11-04T23:54:42.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39010
18042024-11-04T23:54:42.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58514 req_id = 39b59ca8-f077-4fd8-a72a-b8b0fb905a11 response_code = 200 uri = /v2p
18052024-11-04T23:54:42.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 393 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39010 req_id = bb63fb79-3604-4da9-bc7a-da76af1414ff response_code = 200 uri = /v2p
18062024-11-04T23:54:42.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8687 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39658 req_id = e2a8d1a9-c831-4c29-8fe4-478624548884 response_code = 204 uri = /vpc-routes
18072024-11-04T23:54:42.856ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
18082024-11-04T23:54:42.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34353 req_id = 7634ddbb-0182-4813-8729-8e88bad13e97 response_code = 204 uri = /vpc-routes
18092024-11-04T23:54:42.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 265610 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52571 req_id = b33467c6-3d90-43a6-80e5-0974a8c4e280 response_code = 200 uri = /inventory
18102024-11-04T23:54:42.900ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
18112024-11-04T23:54:42.900ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/omicron-zones.json file = common/src/ledger.rs:177
18122024-11-04T23:54:42.901ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/omicron-zones.json file = common/src/ledger.rs:177
18132024-11-04T23:54:42.961ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
18142024-11-04T23:54:42.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 890 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54447 req_id = 54904977-829b-4e79-afa5-8702f8987269 response_code = 204 uri = /vpc-routes
18152024-11-04T23:54:43.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 485602 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48938 req_id = 2b146019-f67a-459a-bc80-b0b3d5794641 response_code = 200 uri = /inventory
18162024-11-04T23:54:43.122ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
18172024-11-04T23:54:43.122ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/omicron-zones.json file = common/src/ledger.rs:177
18182024-11-04T23:54:43.122ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/omicron-zones.json file = common/src/ledger.rs:177
18192024-11-04T23:54:43.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 559840 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45619 req_id = a5805966-75d7-4de9-ab84-e0dcd54c45b4 response_code = 200 uri = /inventory
18202024-11-04T23:54:43.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64187
18212024-11-04T23:54:43.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
18222024-11-04T23:54:43.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
18232024-11-04T23:54:43.397ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/omicron-zones.json file = common/src/ledger.rs:177
18242024-11-04T23:54:43.397ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/omicron-zones.json file = common/src/ledger.rs:177
18252024-11-04T23:54:43.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 226066 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64187 req_id = 5d1a9a19-82ea-4306-af0e-fdaa9aa6190a response_code = 200 uri = /inventory
18262024-11-04T23:54:45.210ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39294
18272024-11-04T23:54:45.214ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39294 req_id = cd7438dc-4929-406f-a9bd-58c1635917c3 response_code = 200 uri = /baseboard
18282024-11-04T23:54:45.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47602
18292024-11-04T23:54:45.520ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7155d12f-56d4-469c-89f3-97766104983b, kind: Service { id: d840e2fc-5a49-44c2-87c1-9190f4e47113 }, name: Name("external-dns-d840e2fc-5a49-44c2-87c1-9190f4e47113"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da209965-7111-4076-a7e7-ba8fb40d3572, kind: Service { id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295 }, name: Name("external-dns-5f4c9dd5-dad6-4fc2-ba58-b064adbea295"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b3056cef-70ef-4c2c-9b47-f29485e812ed, kind: Service { id: 3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd }, name: Name("nexus-3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e75b87c5-0d01-4e92-b145-05ce8da9b4ce, kind: Service { id: 2bc59dd6-be0a-4755-adc1-2be053a1e284 }, name: Name("nexus-2bc59dd6-be0a-4755-adc1-2be053a1e284"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ee017e11-2d79-4135-9b0e-ae0d2aaa0345, kind: Service { id: 96aa1415-4c39-4ede-a09d-b8326a8455f7 }, name: Name("nexus-96aa1415-4c39-4ede-a09d-b8326a8455f7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18302024-11-04T23:54:45.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18312024-11-04T23:54:45.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18322024-11-04T23:54:45.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18332024-11-04T23:54:45.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18342024-11-04T23:54:45.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18352024-11-04T23:54:45.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18362024-11-04T23:54:45.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3451 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47602 req_id = 4138f070-1920-43ef-ba79-a6e93f8b025a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18372024-11-04T23:54:45.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47022
18382024-11-04T23:54:45.520ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7155d12f-56d4-469c-89f3-97766104983b, kind: Service { id: d840e2fc-5a49-44c2-87c1-9190f4e47113 }, name: Name("external-dns-d840e2fc-5a49-44c2-87c1-9190f4e47113"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da209965-7111-4076-a7e7-ba8fb40d3572, kind: Service { id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295 }, name: Name("external-dns-5f4c9dd5-dad6-4fc2-ba58-b064adbea295"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b3056cef-70ef-4c2c-9b47-f29485e812ed, kind: Service { id: 3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd }, name: Name("nexus-3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e75b87c5-0d01-4e92-b145-05ce8da9b4ce, kind: Service { id: 2bc59dd6-be0a-4755-adc1-2be053a1e284 }, name: Name("nexus-2bc59dd6-be0a-4755-adc1-2be053a1e284"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ee017e11-2d79-4135-9b0e-ae0d2aaa0345, kind: Service { id: 96aa1415-4c39-4ede-a09d-b8326a8455f7 }, name: Name("nexus-96aa1415-4c39-4ede-a09d-b8326a8455f7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18392024-11-04T23:54:45.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18402024-11-04T23:54:45.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18412024-11-04T23:54:45.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18422024-11-04T23:54:45.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18432024-11-04T23:54:45.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18442024-11-04T23:54:45.520ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18452024-11-04T23:54:45.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47022 req_id = 732b6c95-3d63-44fc-8eaf-6c3c2ffa2678 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18462024-11-04T23:54:45.521ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:968
18472024-11-04T23:54:45.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61540
18482024-11-04T23:54:45.541ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7155d12f-56d4-469c-89f3-97766104983b, kind: Service { id: d840e2fc-5a49-44c2-87c1-9190f4e47113 }, name: Name("external-dns-d840e2fc-5a49-44c2-87c1-9190f4e47113"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da209965-7111-4076-a7e7-ba8fb40d3572, kind: Service { id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295 }, name: Name("external-dns-5f4c9dd5-dad6-4fc2-ba58-b064adbea295"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b3056cef-70ef-4c2c-9b47-f29485e812ed, kind: Service { id: 3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd }, name: Name("nexus-3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e75b87c5-0d01-4e92-b145-05ce8da9b4ce, kind: Service { id: 2bc59dd6-be0a-4755-adc1-2be053a1e284 }, name: Name("nexus-2bc59dd6-be0a-4755-adc1-2be053a1e284"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ee017e11-2d79-4135-9b0e-ae0d2aaa0345, kind: Service { id: 96aa1415-4c39-4ede-a09d-b8326a8455f7 }, name: Name("nexus-96aa1415-4c39-4ede-a09d-b8326a8455f7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18492024-11-04T23:54:45.541ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18502024-11-04T23:54:45.541ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18512024-11-04T23:54:45.541ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18522024-11-04T23:54:45.541ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18532024-11-04T23:54:45.541ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18542024-11-04T23:54:45.541ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18552024-11-04T23:54:45.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 390 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61540 req_id = 6ec1d5a5-ac73-4d0e-addb-c0adaacfebeb response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18562024-11-04T23:54:45.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54360
18572024-11-04T23:54:45.803ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7155d12f-56d4-469c-89f3-97766104983b, kind: Service { id: d840e2fc-5a49-44c2-87c1-9190f4e47113 }, name: Name("external-dns-d840e2fc-5a49-44c2-87c1-9190f4e47113"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da209965-7111-4076-a7e7-ba8fb40d3572, kind: Service { id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295 }, name: Name("external-dns-5f4c9dd5-dad6-4fc2-ba58-b064adbea295"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b3056cef-70ef-4c2c-9b47-f29485e812ed, kind: Service { id: 3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd }, name: Name("nexus-3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e75b87c5-0d01-4e92-b145-05ce8da9b4ce, kind: Service { id: 2bc59dd6-be0a-4755-adc1-2be053a1e284 }, name: Name("nexus-2bc59dd6-be0a-4755-adc1-2be053a1e284"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ee017e11-2d79-4135-9b0e-ae0d2aaa0345, kind: Service { id: 96aa1415-4c39-4ede-a09d-b8326a8455f7 }, name: Name("nexus-96aa1415-4c39-4ede-a09d-b8326a8455f7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18582024-11-04T23:54:45.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18592024-11-04T23:54:45.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18602024-11-04T23:54:45.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18612024-11-04T23:54:45.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18622024-11-04T23:54:45.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18632024-11-04T23:54:45.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18642024-11-04T23:54:45.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54360 req_id = a1f24792-edaf-48e1-b9ce-270ed37e89d5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18652024-11-04T23:54:45.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47231
18662024-11-04T23:54:45.834ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
18672024-11-04T23:54:45.834ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
18682024-11-04T23:54:45.834ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/omicron-zones.json file = common/src/ledger.rs:177
18692024-11-04T23:54:45.835ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/omicron-zones.json file = common/src/ledger.rs:177
18702024-11-04T23:54:46.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 218970 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47231 req_id = 359f1293-59d7-4acb-a5ba-1fabcdaa3588 response_code = 200 uri = /inventory
18712024-11-04T23:54:50.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59432
18722024-11-04T23:54:50.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59432 req_id = 399baf26-cb13-407c-aa6e-2de27d39ba1b response_code = 200 uri = /vpc-routes
18732024-11-04T23:54:50.681ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
18742024-11-04T23:54:50.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59432 req_id = 39b3efe4-afef-40de-922d-f250b962bf03 response_code = 204 uri = /eip-gateways
18752024-11-04T23:54:50.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59432 req_id = b2a300df-cc90-4ae9-b1f3-e41acef6ca07 response_code = 204 uri = /vpc-routes
18762024-11-04T23:54:57.016ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:41419 remote_addr = [fd00:1122:3344:101::d]:62345 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18772024-11-04T23:54:57.045ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 27995 local_addr = [fd00:1122:3344:101::1]:41419 method = GET remote_addr = [fd00:1122:3344:101::d]:62345 req_id = 5771434b-2e6e-496b-a1dc-63d6cd11bba3 response_code = 200 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 uri = /e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
18782024-11-04T23:55:12.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43043
18792024-11-04T23:55:12.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43043 req_id = 2b954eb0-eb22-4dd9-b3d2-a6d18ec7bcbe response_code = 200 uri = /vpc-routes
18802024-11-04T23:55:12.401ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
18812024-11-04T23:55:12.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43043 req_id = 28d91ad4-1d22-4026-b594-048bd7ae5e28 response_code = 204 uri = /eip-gateways
18822024-11-04T23:55:12.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53159
18832024-11-04T23:55:12.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53159 req_id = 01821ed0-fe2a-4279-91e5-a995c079d462 response_code = 200 uri = /vpc-routes
18842024-11-04T23:55:12.477ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
18852024-11-04T23:55:12.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53159 req_id = 4c45699c-76f9-4a45-bc56-fc9a48b204fd response_code = 204 uri = /eip-gateways
18862024-11-04T23:55:12.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55777
18872024-11-04T23:55:12.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55777 req_id = 2c0d0de1-bc34-4f11-8e1a-6043de162cd9 response_code = 200 uri = /v2p
18882024-11-04T23:55:12.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43043 req_id = 3588e644-e71c-4445-aeea-5aed1fc30a2f response_code = 204 uri = /vpc-routes
18892024-11-04T23:55:12.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55657
18902024-11-04T23:55:12.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55657 req_id = 39da936f-1554-4d30-9b68-8164bec81abd response_code = 200 uri = /v2p
18912024-11-04T23:55:12.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53159 req_id = 4af8373f-f3a6-4fb1-8e75-44f74c5e3aad response_code = 204 uri = /vpc-routes
18922024-11-04T23:55:12.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58130
18932024-11-04T23:55:12.633ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18942024-11-04T23:55:12.722ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18952024-11-04T23:55:12.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 153937 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58130 req_id = 5883e5aa-c9b0-4926-b79e-d999113451ad response_code = 204 uri = /switch-ports
18962024-11-04T23:55:12.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41837
18972024-11-04T23:55:12.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43033
18982024-11-04T23:55:12.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43033 req_id = d52b1f80-e772-4999-885b-d6d2cb944755 response_code = 200 uri = /vpc-routes
18992024-11-04T23:55:12.787ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19002024-11-04T23:55:12.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4546 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58130 req_id = cb4d78e2-ac4c-4c11-9530-cef1609e3285 response_code = 200 uri = /network-bootstore-config
19012024-11-04T23:55:12.831ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19022024-11-04T23:55:12.834ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
19032024-11-04T23:55:12.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51380
19042024-11-04T23:55:12.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 605 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43033 req_id = 9445ce18-e2a6-499b-92c8-1dedd197d57b response_code = 204 uri = /eip-gateways
19052024-11-04T23:55:12.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51380 req_id = ea50eb14-d19c-4fa1-9109-18be0e9e5d13 response_code = 200 uri = /v2p
19062024-11-04T23:55:12.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 988 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43033 req_id = 1c05e0be-b922-4015-8d3f-b2123bc6892e response_code = 204 uri = /vpc-routes
19072024-11-04T23:55:12.890ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
19082024-11-04T23:55:12.890ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19092024-11-04T23:55:12.892ZINFOSledAgent (bootstore): Writing ledger to /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19102024-11-04T23:55:12.893ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19112024-11-04T23:55:12.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58130 req_id = a624705c-5e74-432b-b8f9-3301ef9e4365 response_code = 204 uri = /network-bootstore-config
19122024-11-04T23:55:12.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110987 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41837 req_id = 5c80b877-4ba3-43ce-b226-d9702c57ae89 response_code = 204 uri = /switch-ports
19132024-11-04T23:55:12.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41837 req_id = 1837eb9f-7f5f-409d-b7a3-d6dcd436dab1 response_code = 200 uri = /network-bootstore-config
19142024-11-04T23:55:12.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52918
19152024-11-04T23:55:12.923ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19162024-11-04T23:55:12.958ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19172024-11-04T23:55:13.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90354 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52918 req_id = 832cfa14-7f8c-4349-aef5-5581c9887867 response_code = 204 uri = /switch-ports
19182024-11-04T23:55:13.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52918 req_id = 510c1e37-f630-46b1-a22e-cc506c61ff44 response_code = 200 uri = /network-bootstore-config
19192024-11-04T23:55:15.249ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33624
19202024-11-04T23:55:15.249ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33624 req_id = 92bd1ccf-7318-4360-9621-f506d5acb1cf response_code = 200 uri = /baseboard
19212024-11-04T23:55:42.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37268
19222024-11-04T23:55:42.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37268 req_id = e0e7ec99-5dae-43a7-92ec-bee8251921cd response_code = 200 uri = /vpc-routes
19232024-11-04T23:55:42.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59230
19242024-11-04T23:55:42.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59230 req_id = 2f8a7666-139f-49fd-b8bb-bc9c69ad0a5d response_code = 200 uri = /v2p
19252024-11-04T23:55:42.482ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
19262024-11-04T23:55:42.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37268 req_id = c2ec73c3-912d-43cc-a297-b5ce506c03a3 response_code = 204 uri = /eip-gateways
19272024-11-04T23:55:42.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37268 req_id = 89959360-7dc3-41e6-a7cc-df900c5475f6 response_code = 204 uri = /vpc-routes
19282024-11-04T23:55:42.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43441
19292024-11-04T23:55:42.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43441 req_id = 75fbe798-eb70-4bde-a417-7d0784c05d24 response_code = 200 uri = /vpc-routes
19302024-11-04T23:55:42.537ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
19312024-11-04T23:55:42.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43441 req_id = 5e014710-0334-4b78-a348-6c70baeda318 response_code = 204 uri = /eip-gateways
19322024-11-04T23:55:42.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36572
19332024-11-04T23:55:42.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36572 req_id = 9ce2c3f7-5e4a-4bb5-a2df-1efc8e16ed47 response_code = 200 uri = /v2p
19342024-11-04T23:55:42.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43441 req_id = 898db571-0182-4895-9bd0-28cf11398ff8 response_code = 204 uri = /vpc-routes
19352024-11-04T23:55:42.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37361
19362024-11-04T23:55:42.692ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19372024-11-04T23:55:42.732ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19382024-11-04T23:55:42.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100261 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37361 req_id = 3df22f9f-b91c-46f3-9774-2f8ed36b62ff response_code = 204 uri = /switch-ports
19392024-11-04T23:55:42.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38026
19402024-11-04T23:55:42.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43379
19412024-11-04T23:55:42.792ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19422024-11-04T23:55:42.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3645 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37361 req_id = 8e203aac-d4ea-4608-92e3-1557eb4796d4 response_code = 200 uri = /network-bootstore-config
19432024-11-04T23:55:42.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3627 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38026 req_id = 2619a486-adf3-4114-93e6-78185ef070a2 response_code = 200 uri = /vpc-routes
19442024-11-04T23:55:42.832ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19452024-11-04T23:55:42.848ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
19462024-11-04T23:55:42.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 722 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38026 req_id = d72a4f72-3359-4282-82f4-765db0a33744 response_code = 204 uri = /eip-gateways
19472024-11-04T23:55:42.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101892 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43379 req_id = 80620cb9-c548-4fdb-ab34-cbeaf1c2e205 response_code = 204 uri = /switch-ports
19482024-11-04T23:55:42.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43379 req_id = 662f7127-830c-4c29-a6c3-feb2cd90c334 response_code = 200 uri = /network-bootstore-config
19492024-11-04T23:55:42.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35529
19502024-11-04T23:55:42.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35529 req_id = 36b0d089-b013-4268-83e9-797314fa5b1b response_code = 200 uri = /v2p
19512024-11-04T23:55:42.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38026 req_id = ac9f5be3-8caf-4a20-9e97-316a66a2bf57 response_code = 204 uri = /vpc-routes
19522024-11-04T23:55:43.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61706
19532024-11-04T23:55:43.102ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19542024-11-04T23:55:43.143ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19552024-11-04T23:55:43.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98711 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61706 req_id = 0e24783b-de8a-4747-a524-0b3601335d31 response_code = 204 uri = /switch-ports
19562024-11-04T23:55:43.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61706 req_id = c0346cf6-9198-479a-8574-ba770d34a7fa response_code = 200 uri = /network-bootstore-config
19572024-11-04T23:55:45.283ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35907
19582024-11-04T23:55:45.283ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35907 req_id = d62ccda8-c47c-4ac3-aace-129a1692b3b9 response_code = 200 uri = /baseboard
19592024-11-04T23:55:53.392ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19602024-11-04T23:56:12.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65189
19612024-11-04T23:56:12.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65189 req_id = 670f22c2-e69f-4f5f-82bd-01db4efb838b response_code = 200 uri = /vpc-routes
19622024-11-04T23:56:12.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45803
19632024-11-04T23:56:12.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 22 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45803 req_id = 5534b6fa-2eee-4cfa-8b8c-c016e85a4e35 response_code = 200 uri = /vpc-routes
19642024-11-04T23:56:12.331ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
19652024-11-04T23:56:12.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65189 req_id = a160450f-1f05-48bc-a272-7a9f5b810aca response_code = 204 uri = /eip-gateways
19662024-11-04T23:56:12.378ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
19672024-11-04T23:56:12.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45803 req_id = f8b13518-b93a-4953-94dd-3a83987e8981 response_code = 204 uri = /eip-gateways
19682024-11-04T23:56:12.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44404
19692024-11-04T23:56:12.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44404 req_id = 037bef4a-820a-4a42-bc42-546d0d55421f response_code = 200 uri = /v2p
19702024-11-04T23:56:12.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65189 req_id = a3fac6bf-f883-4b4c-9699-897811b67c35 response_code = 204 uri = /vpc-routes
19712024-11-04T23:56:12.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45803 req_id = 436bc602-7905-43f6-b45c-afd8f1bcea36 response_code = 204 uri = /vpc-routes
19722024-11-04T23:56:12.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63989
19732024-11-04T23:56:12.541ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19742024-11-04T23:56:12.580ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19752024-11-04T23:56:12.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108445 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63989 req_id = f7d09fe1-9d27-4ad8-bd9a-f573d069ecda response_code = 204 uri = /switch-ports
19762024-11-04T23:56:12.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63932
19772024-11-04T23:56:12.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62300
19782024-11-04T23:56:12.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63989 req_id = ae7d9f64-efe7-4edc-a6b2-accae232281e response_code = 200 uri = /network-bootstore-config
19792024-11-04T23:56:12.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63932 req_id = 1e2b87be-fe02-4afd-9248-eb772b4586ef response_code = 200 uri = /vpc-routes
19802024-11-04T23:56:12.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62300 req_id = 155c3cba-bb39-4873-b7d6-efecca9cdec6 response_code = 200 uri = /v2p
19812024-11-04T23:56:12.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40338
19822024-11-04T23:56:12.678ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19832024-11-04T23:56:12.716ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19842024-11-04T23:56:12.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93717 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40338 req_id = 92abd724-6f67-4089-9028-d66aae23eb3f response_code = 204 uri = /switch-ports
19852024-11-04T23:56:12.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48855
19862024-11-04T23:56:12.772ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
19872024-11-04T23:56:12.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63932 req_id = a5b4ea70-97ac-499d-a0d2-570018b7549d response_code = 204 uri = /eip-gateways
19882024-11-04T23:56:12.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40338 req_id = 35c46ad5-93f7-49ec-963e-2e9234d6f233 response_code = 200 uri = /network-bootstore-config
19892024-11-04T23:56:12.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48855 req_id = 6e9c1c21-544c-495e-9119-8a2de5531de0 response_code = 200 uri = /v2p
19902024-11-04T23:56:12.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63932 req_id = 92990761-5dd5-4723-87b6-ae4ba25eacda response_code = 204 uri = /vpc-routes
19912024-11-04T23:56:12.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55310
19922024-11-04T23:56:12.884ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19932024-11-04T23:56:12.921ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19942024-11-04T23:56:12.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90691 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55310 req_id = 12255070-4d76-46bd-b970-557ff6b92385 response_code = 204 uri = /switch-ports
19952024-11-04T23:56:12.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55310 req_id = 68f1a48c-8b06-49a1-ac4f-0c0ac987bc62 response_code = 200 uri = /network-bootstore-config
19962024-11-04T23:56:15.319ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34757
19972024-11-04T23:56:15.319ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34757 req_id = 6ff8775c-31c5-4f06-ab48-59dda2e34b9a response_code = 200 uri = /baseboard
19982024-11-04T23:56:42.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38452
19992024-11-04T23:56:42.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38452 req_id = c401d0af-232e-45d9-b216-0a84fb3b0512 response_code = 200 uri = /vpc-routes
20002024-11-04T23:56:42.440ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
20012024-11-04T23:56:42.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38452 req_id = 8a9418e8-07d6-49c5-bff4-85eed0732aa6 response_code = 204 uri = /eip-gateways
20022024-11-04T23:56:42.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38452 req_id = d18f4dd4-9533-4b5e-b87c-a62ce62c9906 response_code = 204 uri = /vpc-routes
20032024-11-04T23:56:42.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45209
20042024-11-04T23:56:42.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45209 req_id = 429c3ea4-3373-4084-a19d-f26c1efc5881 response_code = 200 uri = /vpc-routes
20052024-11-04T23:56:42.583ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
20062024-11-04T23:56:42.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45209 req_id = 188bdfcf-6f63-4c3f-8e48-f07b58734fda response_code = 204 uri = /eip-gateways
20072024-11-04T23:56:42.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42140
20082024-11-04T23:56:42.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42140 req_id = 88f0608e-ed0f-4188-8a27-78f72376b73c response_code = 200 uri = /v2p
20092024-11-04T23:56:42.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55359
20102024-11-04T23:56:42.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55359 req_id = d16efc1d-cdb3-431e-80a6-05dcdc0b848c response_code = 200 uri = /v2p
20112024-11-04T23:56:42.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61200
20122024-11-04T23:56:42.684ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20132024-11-04T23:56:42.720ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20142024-11-04T23:56:42.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87650 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61200 req_id = 2290c33f-fd52-443d-b92c-9d36d77f090c response_code = 204 uri = /switch-ports
20152024-11-04T23:56:42.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61200 req_id = 3b16b566-6265-48a3-9aea-309030122095 response_code = 200 uri = /network-bootstore-config
20162024-11-04T23:56:42.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45209 req_id = 3b6fd6ec-b15c-47ac-86f0-f0989059237d response_code = 204 uri = /vpc-routes
20172024-11-04T23:56:42.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40345
20182024-11-04T23:56:42.792ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20192024-11-04T23:56:42.827ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20202024-11-04T23:56:42.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86794 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40345 req_id = c864419b-4c9f-46b9-9bb5-62d84d13a235 response_code = 204 uri = /switch-ports
20212024-11-04T23:56:42.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55041
20222024-11-04T23:56:42.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55269
20232024-11-04T23:56:42.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40345 req_id = 23b1366e-03bd-483d-b15a-8cc1fe172418 response_code = 200 uri = /network-bootstore-config
20242024-11-04T23:56:42.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55269 req_id = b8b8f508-fb70-4494-b2f5-3b56e63588ad response_code = 200 uri = /vpc-routes
20252024-11-04T23:56:42.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55041 req_id = bd0e28fb-637c-4102-bf27-6d7af7783035 response_code = 200 uri = /v2p
20262024-11-04T23:56:42.920ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
20272024-11-04T23:56:42.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55269 req_id = fcb2babc-16f7-4372-b344-004714fb67bc response_code = 204 uri = /eip-gateways
20282024-11-04T23:56:42.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55269 req_id = 5f6ef2a5-ea0a-429c-8591-869758c7f346 response_code = 204 uri = /vpc-routes
20292024-11-04T23:56:43.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50307
20302024-11-04T23:56:43.100ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20312024-11-04T23:56:43.139ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20322024-11-04T23:56:43.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96397 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50307 req_id = 9ec88b58-945f-4271-ac7f-f496825c1aa0 response_code = 204 uri = /switch-ports
20332024-11-04T23:56:43.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50307 req_id = a68ee5d7-f3ef-4478-adfc-9d8ea52105d8 response_code = 200 uri = /network-bootstore-config
20342024-11-04T23:56:45.353ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45356
20352024-11-04T23:56:45.353ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45356 req_id = 09c213d6-99c1-4d24-88b8-7b151f7b9535 response_code = 200 uri = /baseboard
20362024-11-04T23:57:12.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34281
20372024-11-04T23:57:12.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34281 req_id = 8ab87695-3a31-42a4-82b8-d1cd0ffbaed8 response_code = 200 uri = /vpc-routes
20382024-11-04T23:57:12.400ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
20392024-11-04T23:57:12.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34281 req_id = 4d13c0bb-b2e4-41bd-97a8-f31fc2db1238 response_code = 204 uri = /eip-gateways
20402024-11-04T23:57:12.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34281 req_id = 4800ab79-89bf-438e-8352-378cde84c57b response_code = 204 uri = /vpc-routes
20412024-11-04T23:57:12.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42065
20422024-11-04T23:57:12.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42065 req_id = 992cab76-f93a-4d59-b9d6-cefe7739dcfb response_code = 200 uri = /vpc-routes
20432024-11-04T23:57:12.473ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
20442024-11-04T23:57:12.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42065 req_id = 0564797c-3d8c-454e-9ae0-4f0939450b55 response_code = 204 uri = /eip-gateways
20452024-11-04T23:57:12.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46606
20462024-11-04T23:57:12.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46606 req_id = 18effdb9-f18a-4a46-a108-20e69c5b27aa response_code = 200 uri = /v2p
20472024-11-04T23:57:12.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40082
20482024-11-04T23:57:12.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40082 req_id = 116597eb-78d8-41fd-8994-3b82c40d685e response_code = 200 uri = /v2p
20492024-11-04T23:57:12.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32908
20502024-11-04T23:57:12.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32908 req_id = 41c02bf3-a877-44ee-b8c7-018fd8cf2297 response_code = 200 uri = /vpc-routes
20512024-11-04T23:57:12.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42065 req_id = b7c2233c-899f-46cc-9ab9-056083b59657 response_code = 204 uri = /vpc-routes
20522024-11-04T23:57:12.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41844
20532024-11-04T23:57:12.614ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20542024-11-04T23:57:12.652ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20552024-11-04T23:57:12.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96091 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41844 req_id = 4a082614-66db-4103-8ebe-9902549a4b69 response_code = 204 uri = /switch-ports
20562024-11-04T23:57:12.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52885
20572024-11-04T23:57:12.710ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
20582024-11-04T23:57:12.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32908 req_id = 17bbd989-99ac-4229-b5d1-777b61309c10 response_code = 204 uri = /eip-gateways
20592024-11-04T23:57:12.710ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20602024-11-04T23:57:12.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41844 req_id = 2bed1b0f-4c2a-4e2a-aede-6b874a7252ed response_code = 200 uri = /network-bootstore-config
20612024-11-04T23:57:12.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32908 req_id = f64eb1bc-c83b-4691-aef8-ea4302d7aa3b response_code = 204 uri = /vpc-routes
20622024-11-04T23:57:12.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44818
20632024-11-04T23:57:12.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44818 req_id = 8c81cd73-e5f5-4fb4-b098-8996cc405f13 response_code = 200 uri = /v2p
20642024-11-04T23:57:12.746ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20652024-11-04T23:57:12.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88148 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52885 req_id = 53372067-371a-445b-b036-77f6fe015df1 response_code = 204 uri = /switch-ports
20662024-11-04T23:57:12.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52885 req_id = 8395586d-ad90-4eb0-837f-72bfee34d5dc response_code = 200 uri = /network-bootstore-config
20672024-11-04T23:57:12.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51512
20682024-11-04T23:57:12.809ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20692024-11-04T23:57:12.842ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20702024-11-04T23:57:12.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82956 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51512 req_id = abba8d9b-0833-4739-8adc-e575af0c8c09 response_code = 204 uri = /switch-ports
20712024-11-04T23:57:12.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51512 req_id = 65429c25-db40-443a-bc26-47d564a66a80 response_code = 200 uri = /network-bootstore-config
20722024-11-04T23:57:15.388ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51872
20732024-11-04T23:57:15.388ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51872 req_id = dc5dcec9-179c-4fa0-8fee-85ea74799eea response_code = 200 uri = /baseboard
20742024-11-04T23:57:42.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63376
20752024-11-04T23:57:42.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63376 req_id = 7dd88f3b-694e-43a0-b3a5-8c91cb436bfc response_code = 200 uri = /vpc-routes
20762024-11-04T23:57:42.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64837
20772024-11-04T23:57:42.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64837 req_id = cb738985-c77c-4bbd-9a69-ee5551cac0a0 response_code = 200 uri = /vpc-routes
20782024-11-04T23:57:42.571ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
20792024-11-04T23:57:42.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63376 req_id = 559226ff-4bd8-4535-a675-f7b4903d16eb response_code = 204 uri = /eip-gateways
20802024-11-04T23:57:42.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52540
20812024-11-04T23:57:42.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52540 req_id = ca8b4ed6-47c6-4803-a8cd-525044fbcf00 response_code = 200 uri = /v2p
20822024-11-04T23:57:42.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63376 req_id = 233076df-98cc-4f79-a6e0-aca6d12e8163 response_code = 204 uri = /vpc-routes
20832024-11-04T23:57:42.599ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
20842024-11-04T23:57:42.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64837 req_id = 25b5594f-46ad-4253-ae46-98e8e287591e response_code = 204 uri = /eip-gateways
20852024-11-04T23:57:42.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43182
20862024-11-04T23:57:42.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43182 req_id = 84582652-ec97-4e64-be92-6aa7237a405b response_code = 200 uri = /v2p
20872024-11-04T23:57:42.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64837 req_id = 60427384-c641-483f-8985-25066f1303fc response_code = 204 uri = /vpc-routes
20882024-11-04T23:57:42.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55909
20892024-11-04T23:57:42.705ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20902024-11-04T23:57:42.746ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20912024-11-04T23:57:42.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97617 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55909 req_id = a94f4060-914c-4b94-9584-e2994d87605b response_code = 204 uri = /switch-ports
20922024-11-04T23:57:42.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40615
20932024-11-04T23:57:42.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55909 req_id = 9e05b7e7-6bc2-4e93-81c9-386456bc247b response_code = 200 uri = /network-bootstore-config
20942024-11-04T23:57:42.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40615 req_id = 63ac3c3a-2538-4d71-849e-382511b3c0d3 response_code = 200 uri = /vpc-routes
20952024-11-04T23:57:42.852ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
20962024-11-04T23:57:42.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40615 req_id = f40b7dfd-93f0-448a-9e91-d00a70853fd9 response_code = 204 uri = /eip-gateways
20972024-11-04T23:57:42.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44202
20982024-11-04T23:57:42.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44202 req_id = 04ceab20-9e42-4f01-86af-9c9a5866f795 response_code = 200 uri = /v2p
20992024-11-04T23:57:42.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40615 req_id = 03cd5473-d482-4803-9105-77b3caf85ef2 response_code = 204 uri = /vpc-routes
21002024-11-04T23:57:42.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40821
21012024-11-04T23:57:42.966ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21022024-11-04T23:57:43.000ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21032024-11-04T23:57:43.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89858 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40821 req_id = dd3692d0-8907-4e67-a902-d0167f2a1ba9 response_code = 204 uri = /switch-ports
21042024-11-04T23:57:43.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50033
21052024-11-04T23:57:43.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40821 req_id = 57c8f13c-5c8f-4f49-9614-129bc79817fa response_code = 200 uri = /network-bootstore-config
21062024-11-04T23:57:43.056ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21072024-11-04T23:57:43.092ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21082024-11-04T23:57:43.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93828 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50033 req_id = 4badbf28-1833-43ac-a173-0c506488b184 response_code = 204 uri = /switch-ports
21092024-11-04T23:57:43.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50033 req_id = b14edc91-4dc2-483b-b144-b2392f1006ba response_code = 200 uri = /network-bootstore-config
21102024-11-04T23:57:45.424ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45631
21112024-11-04T23:57:45.424ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45631 req_id = 8b6d13c6-8396-4290-bc30-a2477e4b83f1 response_code = 200 uri = /baseboard
21122024-11-04T23:58:12.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57162
21132024-11-04T23:58:12.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57162 req_id = 436a7c76-fa5c-43a8-a0a1-39e33e84e0a0 response_code = 200 uri = /vpc-routes
21142024-11-04T23:58:12.397ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
21152024-11-04T23:58:12.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57162 req_id = ffd85e12-1298-4f3a-ba4f-482eef3cad06 response_code = 204 uri = /eip-gateways
21162024-11-04T23:58:12.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63809
21172024-11-04T23:58:12.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63809 req_id = f13b75c9-e3e1-4f80-9aa2-c48089cf24e1 response_code = 200 uri = /vpc-routes
21182024-11-04T23:58:12.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57162 req_id = cfd553dc-d662-4252-994f-509848712179 response_code = 204 uri = /vpc-routes
21192024-11-04T23:58:12.427ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
21202024-11-04T23:58:12.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63809 req_id = 417f9215-118b-4a85-8b42-f18e779001b8 response_code = 204 uri = /eip-gateways
21212024-11-04T23:58:12.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63809 req_id = 4a1c3550-3a37-4c72-a9b8-a9b47d37630b response_code = 204 uri = /vpc-routes
21222024-11-04T23:58:12.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40055
21232024-11-04T23:58:12.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40055 req_id = bd4a5d0f-168f-45b9-b576-c34f8e1e76d0 response_code = 200 uri = /v2p
21242024-11-04T23:58:12.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52932
21252024-11-04T23:58:12.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52932 req_id = 4d63aa0b-3711-4e30-9a00-ae0b9833604d response_code = 200 uri = /v2p
21262024-11-04T23:58:12.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45703
21272024-11-04T23:58:12.544ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21282024-11-04T23:58:12.590ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21292024-11-04T23:58:12.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107340 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45703 req_id = f3ff728c-6f37-4eea-81d2-2e22801d2553 response_code = 204 uri = /switch-ports
21302024-11-04T23:58:12.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61983
21312024-11-04T23:58:12.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50473
21322024-11-04T23:58:12.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43193
21332024-11-04T23:58:12.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45703 req_id = 934f7d02-2b4c-414a-8ffb-fe6cb3cbc4a3 response_code = 200 uri = /network-bootstore-config
21342024-11-04T23:58:12.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61983 req_id = 40886cc9-ffbc-440f-8b06-0255a59ba6a9 response_code = 200 uri = /vpc-routes
21352024-11-04T23:58:12.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43193 req_id = 3c6caa38-020b-4d72-8a96-ed893948090b response_code = 200 uri = /v2p
21362024-11-04T23:58:12.652ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21372024-11-04T23:58:12.673ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
21382024-11-04T23:58:12.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 731 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61983 req_id = b4ac95a4-5c1b-485d-b1bc-e78a62371f95 response_code = 204 uri = /eip-gateways
21392024-11-04T23:58:12.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4552 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61983 req_id = 66b5882d-ce64-4870-b80b-9068c9401a6c response_code = 204 uri = /vpc-routes
21402024-11-04T23:58:12.696ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21412024-11-04T23:58:12.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56442
21422024-11-04T23:58:12.754ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21432024-11-04T23:58:12.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101923 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50473 req_id = 76b3ac30-fdc6-431c-89ee-b61e6f955edf response_code = 204 uri = /switch-ports
21442024-11-04T23:58:12.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 545 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50473 req_id = 74b9825c-4c23-4f2b-b96b-55425e4f44e3 response_code = 200 uri = /network-bootstore-config
21452024-11-04T23:58:12.788ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21462024-11-04T23:58:12.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139112 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56442 req_id = 49468c18-c033-40cb-94a9-bec70a47c82b response_code = 204 uri = /switch-ports
21472024-11-04T23:58:12.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56442 req_id = 991c939e-148c-4971-829f-d4badaf2fc3e response_code = 200 uri = /network-bootstore-config
21482024-11-04T23:58:15.458ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47508
21492024-11-04T23:58:15.458ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 83 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47508 req_id = 9e5e26fe-53b5-4c92-86c3-08fcf1ce82f9 response_code = 200 uri = /baseboard
21502024-11-04T23:58:42.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50286
21512024-11-04T23:58:42.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50286 req_id = ba451f59-0741-46f6-b35f-497da5a37c7d response_code = 200 uri = /vpc-routes
21522024-11-04T23:58:42.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36708
21532024-11-04T23:58:42.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36708 req_id = 6dcd249c-e179-4204-a5a3-48187dfe4006 response_code = 200 uri = /vpc-routes
21542024-11-04T23:58:42.518ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
21552024-11-04T23:58:42.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50286 req_id = 20a8a7db-9053-4258-8509-a180ae52864d response_code = 204 uri = /eip-gateways
21562024-11-04T23:58:42.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50286 req_id = 717133cf-0bb2-4835-87d4-da8b14bec36f response_code = 204 uri = /vpc-routes
21572024-11-04T23:58:42.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43875
21582024-11-04T23:58:42.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43875 req_id = a5c56fa6-08d2-4317-aef4-7dc1970d4f3f response_code = 200 uri = /vpc-routes
21592024-11-04T23:58:42.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57483
21602024-11-04T23:58:42.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57483 req_id = 6da59921-4edb-4a07-839e-ea1954e07b6a response_code = 200 uri = /v2p
21612024-11-04T23:58:42.726ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
21622024-11-04T23:58:42.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36708 req_id = b208c5c4-fc58-4adf-8938-dc2af43efd84 response_code = 204 uri = /eip-gateways
21632024-11-04T23:58:42.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50436
21642024-11-04T23:58:42.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50436 req_id = 276c3f75-9011-47a2-bd7b-a9c0328a4bd5 response_code = 200 uri = /v2p
21652024-11-04T23:58:42.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36708 req_id = 8e07ecd6-59a3-49e4-b6a7-46f233f4af66 response_code = 204 uri = /vpc-routes
21662024-11-04T23:58:42.743ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
21672024-11-04T23:58:42.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43875 req_id = d5221265-8f8a-408f-80d3-17c510928cf7 response_code = 204 uri = /eip-gateways
21682024-11-04T23:58:42.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43875 req_id = 9391d3ed-12e1-4921-8469-466c09812238 response_code = 204 uri = /vpc-routes
21692024-11-04T23:58:42.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60338
21702024-11-04T23:58:42.811ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21712024-11-04T23:58:42.850ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21722024-11-04T23:58:42.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96660 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60338 req_id = d41cdaad-ea94-4070-9591-bf9e2feebcec response_code = 204 uri = /switch-ports
21732024-11-04T23:58:42.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44745
21742024-11-04T23:58:42.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60338 req_id = 8aa0267d-4c6b-446c-ac30-a17426c84eec response_code = 200 uri = /network-bootstore-config
21752024-11-04T23:58:42.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44745 req_id = faec8216-9437-415a-a889-46a97a829ba3 response_code = 200 uri = /v2p
21762024-11-04T23:58:42.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56961
21772024-11-04T23:58:42.925ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21782024-11-04T23:58:42.962ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21792024-11-04T23:58:43.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95647 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56961 req_id = f980bf7f-e0ff-493d-a9c3-2387dcdef7bd response_code = 204 uri = /switch-ports
21802024-11-04T23:58:43.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56961 req_id = 75a30242-7347-44bf-a149-c552ed21a90b response_code = 200 uri = /network-bootstore-config
21812024-11-04T23:58:43.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56991
21822024-11-04T23:58:43.065ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21832024-11-04T23:58:43.101ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21842024-11-04T23:58:43.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91311 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56991 req_id = b6659331-9e0f-42eb-859d-82e6a2b47412 response_code = 204 uri = /switch-ports
21852024-11-04T23:58:43.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56991 req_id = 09701a99-3d35-4d05-b1b4-c76f9d82dcbd response_code = 200 uri = /network-bootstore-config
21862024-11-04T23:58:45.490ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56067
21872024-11-04T23:58:45.490ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56067 req_id = c4c3c42c-b46d-4e04-ab9c-1e777cdd6fd1 response_code = 200 uri = /baseboard
21882024-11-04T23:59:12.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50941
21892024-11-04T23:59:12.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50941 req_id = 886bde67-991e-4ca5-9d5f-ce02abde34d8 response_code = 200 uri = /vpc-routes
21902024-11-04T23:59:12.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39407
21912024-11-04T23:59:12.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39407 req_id = 1d32d6d7-3813-45ad-b9c2-e83e45019360 response_code = 200 uri = /vpc-routes
21922024-11-04T23:59:12.388ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
21932024-11-04T23:59:12.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50941 req_id = ff299872-0b2e-4dac-b60b-08b1a63437c2 response_code = 204 uri = /eip-gateways
21942024-11-04T23:59:12.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50941 req_id = 2f68e6ea-17ea-4f87-8d60-cbd450bba5ef response_code = 204 uri = /vpc-routes
21952024-11-04T23:59:12.431ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
21962024-11-04T23:59:12.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39407 req_id = f7ee281f-1e2e-4dcf-9b14-a1088245c0e4 response_code = 204 uri = /eip-gateways
21972024-11-04T23:59:12.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39407 req_id = 4dd6545b-eaa4-43bf-ae9e-a27d9ac4206d response_code = 204 uri = /vpc-routes
21982024-11-04T23:59:12.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57747
21992024-11-04T23:59:12.485ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22002024-11-04T23:59:12.535ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22012024-11-04T23:59:12.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117255 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57747 req_id = 0321f898-d540-4624-9abc-6f90a6f4961f response_code = 204 uri = /switch-ports
22022024-11-04T23:59:12.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64539
22032024-11-04T23:59:12.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39333
22042024-11-04T23:59:12.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37638
22052024-11-04T23:59:12.603ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22062024-11-04T23:59:12.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64539 req_id = 363269c9-753e-43ec-b866-c91e79fca3c7 response_code = 200 uri = /v2p
22072024-11-04T23:59:12.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39333 req_id = 5841118d-1b4f-4ce5-b15a-721eccbcc2a8 response_code = 200 uri = /v2p
22082024-11-04T23:59:12.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57747 req_id = cb6154af-c770-4312-9f37-64611bbad02c response_code = 200 uri = /network-bootstore-config
22092024-11-04T23:59:12.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54458
22102024-11-04T23:59:12.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54458 req_id = 627435b6-0f3f-4f5b-bbf1-825850556e94 response_code = 200 uri = /vpc-routes
22112024-11-04T23:59:12.643ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22122024-11-04T23:59:12.649ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
22132024-11-04T23:59:12.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54458 req_id = ea7dfbb7-5db8-4546-8d37-fafcc48914a5 response_code = 204 uri = /eip-gateways
22142024-11-04T23:59:12.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 885 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54458 req_id = 8009f299-fccc-4f52-9936-74c63704d0bb response_code = 204 uri = /vpc-routes
22152024-11-04T23:59:12.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104062 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37638 req_id = 71517210-d0d3-4a9f-8733-5f6639b0472e response_code = 204 uri = /switch-ports
22162024-11-04T23:59:12.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37638 req_id = bd7fbdaf-e805-4f76-a25f-fa9567be5a9c response_code = 200 uri = /network-bootstore-config
22172024-11-04T23:59:12.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42673
22182024-11-04T23:59:12.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42673 req_id = 0ad2f3d8-2b3e-498c-b550-6ed27f62e4a8 response_code = 200 uri = /v2p
22192024-11-04T23:59:12.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64774
22202024-11-04T23:59:12.809ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22212024-11-04T23:59:12.846ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22222024-11-04T23:59:12.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92139 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64774 req_id = 82273575-1708-480f-9429-35dfe9cfa081 response_code = 204 uri = /switch-ports
22232024-11-04T23:59:12.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64774 req_id = b36e6a67-3b0a-455f-8e86-17c8757fec79 response_code = 200 uri = /network-bootstore-config
22242024-11-04T23:59:15.525ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50741
22252024-11-04T23:59:15.525ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50741 req_id = 4ddb562f-19a3-4e5c-9a13-47f8e53fe0da response_code = 200 uri = /baseboard
22262024-11-04T23:59:42.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57555
22272024-11-04T23:59:42.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57555 req_id = 7c74882b-6df1-4ff5-8391-25100187b904 response_code = 200 uri = /vpc-routes
22282024-11-04T23:59:42.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55892
22292024-11-04T23:59:42.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55892 req_id = 4ccd46c3-3b7d-4566-bbae-02a789685013 response_code = 200 uri = /v2p
22302024-11-04T23:59:42.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61479
22312024-11-04T23:59:42.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61479 req_id = 2aff2d2c-eff0-47aa-b058-98141ee6dc66 response_code = 200 uri = /vpc-routes
22322024-11-04T23:59:42.626ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
22332024-11-04T23:59:42.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57555 req_id = 0b3976aa-8f48-4262-9a1c-b3d7442649d6 response_code = 204 uri = /eip-gateways
22342024-11-04T23:59:42.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57555 req_id = c701d349-d39c-47d1-a84f-efe70ebfaa02 response_code = 204 uri = /vpc-routes
22352024-11-04T23:59:42.687ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
22362024-11-04T23:59:42.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61479 req_id = 429dd6d8-bbd7-47a9-a45c-4683c44e8858 response_code = 204 uri = /eip-gateways
22372024-11-04T23:59:42.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61479 req_id = 4c4f7425-76a8-4d78-bbfe-5897fd1e6bf2 response_code = 204 uri = /vpc-routes
22382024-11-04T23:59:42.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57285
22392024-11-04T23:59:42.699ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22402024-11-04T23:59:42.742ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22412024-11-04T23:59:42.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105939 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57285 req_id = 99463bac-4d3d-4033-a6d1-e8098af532b0 response_code = 204 uri = /switch-ports
22422024-11-04T23:59:42.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39951
22432024-11-04T23:59:42.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44332
22442024-11-04T23:59:42.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38113
22452024-11-04T23:59:42.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57285 req_id = fcb207f6-49c8-4259-a385-aa492c8b0764 response_code = 200 uri = /network-bootstore-config
22462024-11-04T23:59:42.805ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22472024-11-04T23:59:42.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44332 req_id = 8892533d-8be2-4580-98e5-e4f68ce34d09 response_code = 200 uri = /v2p
22482024-11-04T23:59:42.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38113 req_id = eecc0a92-0469-4132-8234-f343a473c975 response_code = 200 uri = /v2p
22492024-11-04T23:59:42.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46841
22502024-11-04T23:59:42.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46841 req_id = ba71dcb8-0f11-4087-be72-4150d7ff6596 response_code = 200 uri = /vpc-routes
22512024-11-04T23:59:42.841ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22522024-11-04T23:59:42.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38827
22532024-11-04T23:59:42.852ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7155d12f-56d4-469c-89f3-97766104983b, kind: Service { id: d840e2fc-5a49-44c2-87c1-9190f4e47113 }, name: Name("external-dns-d840e2fc-5a49-44c2-87c1-9190f4e47113"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da209965-7111-4076-a7e7-ba8fb40d3572, kind: Service { id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295 }, name: Name("external-dns-5f4c9dd5-dad6-4fc2-ba58-b064adbea295"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b3056cef-70ef-4c2c-9b47-f29485e812ed, kind: Service { id: 3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd }, name: Name("nexus-3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e75b87c5-0d01-4e92-b145-05ce8da9b4ce, kind: Service { id: 2bc59dd6-be0a-4755-adc1-2be053a1e284 }, name: Name("nexus-2bc59dd6-be0a-4755-adc1-2be053a1e284"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ee017e11-2d79-4135-9b0e-ae0d2aaa0345, kind: Service { id: 96aa1415-4c39-4ede-a09d-b8326a8455f7 }, name: Name("nexus-96aa1415-4c39-4ede-a09d-b8326a8455f7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22542024-11-04T23:59:42.852ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
22552024-11-04T23:59:42.852ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22562024-11-04T23:59:42.852ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22572024-11-04T23:59:42.852ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22582024-11-04T23:59:42.852ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22592024-11-04T23:59:42.852ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22602024-11-04T23:59:42.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 369 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38827 req_id = 59cba644-6c13-4afb-800a-596b8dfe3464 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22612024-11-04T23:59:42.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63663
22622024-11-04T23:59:42.857ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7155d12f-56d4-469c-89f3-97766104983b, kind: Service { id: d840e2fc-5a49-44c2-87c1-9190f4e47113 }, name: Name("external-dns-d840e2fc-5a49-44c2-87c1-9190f4e47113"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da209965-7111-4076-a7e7-ba8fb40d3572, kind: Service { id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295 }, name: Name("external-dns-5f4c9dd5-dad6-4fc2-ba58-b064adbea295"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b3056cef-70ef-4c2c-9b47-f29485e812ed, kind: Service { id: 3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd }, name: Name("nexus-3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e75b87c5-0d01-4e92-b145-05ce8da9b4ce, kind: Service { id: 2bc59dd6-be0a-4755-adc1-2be053a1e284 }, name: Name("nexus-2bc59dd6-be0a-4755-adc1-2be053a1e284"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ee017e11-2d79-4135-9b0e-ae0d2aaa0345, kind: Service { id: 96aa1415-4c39-4ede-a09d-b8326a8455f7 }, name: Name("nexus-96aa1415-4c39-4ede-a09d-b8326a8455f7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22632024-11-04T23:59:42.857ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
22642024-11-04T23:59:42.857ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22652024-11-04T23:59:42.857ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22662024-11-04T23:59:42.857ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22672024-11-04T23:59:42.857ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22682024-11-04T23:59:42.857ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22692024-11-04T23:59:42.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63663 req_id = 75e1e2e6-d3bb-4fe4-b46f-72b1d2bf3133 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22702024-11-04T23:59:42.868ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
22712024-11-04T23:59:42.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46841 req_id = 8e62ff44-7b26-45e0-8851-9e005c872e70 response_code = 204 uri = /eip-gateways
22722024-11-04T23:59:42.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 778 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46841 req_id = db8ada10-62e4-4e1b-b0fe-5fdfcf082a58 response_code = 204 uri = /vpc-routes
22732024-11-04T23:59:42.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92815 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39951 req_id = c48d953b-a7e8-41af-86a1-3d0e5094a4d9 response_code = 204 uri = /switch-ports
22742024-11-04T23:59:42.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39951 req_id = 01ec2409-d49d-4e02-9124-1948a1316de8 response_code = 200 uri = /network-bootstore-config
22752024-11-04T23:59:42.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45478
22762024-11-04T23:59:42.951ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22772024-11-04T23:59:42.992ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22782024-11-04T23:59:43.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90863 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45478 req_id = 2d3ff059-0f4f-40f7-b5bb-3f07c17a7860 response_code = 204 uri = /switch-ports
22792024-11-04T23:59:43.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45478 req_id = db27fe00-3f09-4a86-a1fc-22196eb6a52b response_code = 200 uri = /network-bootstore-config
22802024-11-04T23:59:43.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55543
22812024-11-04T23:59:43.116ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7155d12f-56d4-469c-89f3-97766104983b, kind: Service { id: d840e2fc-5a49-44c2-87c1-9190f4e47113 }, name: Name("external-dns-d840e2fc-5a49-44c2-87c1-9190f4e47113"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da209965-7111-4076-a7e7-ba8fb40d3572, kind: Service { id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295 }, name: Name("external-dns-5f4c9dd5-dad6-4fc2-ba58-b064adbea295"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b3056cef-70ef-4c2c-9b47-f29485e812ed, kind: Service { id: 3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd }, name: Name("nexus-3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e75b87c5-0d01-4e92-b145-05ce8da9b4ce, kind: Service { id: 2bc59dd6-be0a-4755-adc1-2be053a1e284 }, name: Name("nexus-2bc59dd6-be0a-4755-adc1-2be053a1e284"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ee017e11-2d79-4135-9b0e-ae0d2aaa0345, kind: Service { id: 96aa1415-4c39-4ede-a09d-b8326a8455f7 }, name: Name("nexus-96aa1415-4c39-4ede-a09d-b8326a8455f7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22822024-11-04T23:59:43.116ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
22832024-11-04T23:59:43.116ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22842024-11-04T23:59:43.116ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22852024-11-04T23:59:43.116ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22862024-11-04T23:59:43.116ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22872024-11-04T23:59:43.116ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22882024-11-04T23:59:43.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55543 req_id = 42df5711-20b2-4252-8b54-95f281206f33 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22892024-11-04T23:59:45.559ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54243
22902024-11-04T23:59:45.559ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54243 req_id = 09e97256-e43b-46d3-aa41-1865afc15837 response_code = 200 uri = /baseboard
22912024-11-05T00:00:12.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54321
22922024-11-05T00:00:12.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54321 req_id = 9fc56006-847f-466f-a4d4-3334e8a51b97 response_code = 200 uri = /v2p
22932024-11-05T00:00:12.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42840
22942024-11-05T00:00:12.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42840 req_id = 0a35a4d9-487d-42d7-94cf-bfb38686ca8d response_code = 200 uri = /vpc-routes
22952024-11-05T00:00:12.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36704
22962024-11-05T00:00:12.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36704 req_id = 92673153-999f-4782-a821-d3e929e87d1e response_code = 200 uri = /vpc-routes
22972024-11-05T00:00:12.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40104
22982024-11-05T00:00:12.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40104 req_id = 9bed420f-4913-4c2d-940e-f5e5a9ac4ac6 response_code = 200 uri = /v2p
22992024-11-05T00:00:12.464ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
23002024-11-05T00:00:12.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42840 req_id = bcc9c247-346e-4537-be12-e43b116a6d3b response_code = 204 uri = /eip-gateways
23012024-11-05T00:00:12.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42840 req_id = 4cf40beb-38c8-44a2-81e5-451713e2e9b1 response_code = 204 uri = /vpc-routes
23022024-11-05T00:00:12.481ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
23032024-11-05T00:00:12.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36704 req_id = 57a7f44f-e2ea-4749-8102-2f9c71430a74 response_code = 204 uri = /eip-gateways
23042024-11-05T00:00:12.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36704 req_id = c3b331ab-ad4a-4a30-a42e-f9db3edf0628 response_code = 204 uri = /vpc-routes
23052024-11-05T00:00:12.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48020
23062024-11-05T00:00:12.505ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23072024-11-05T00:00:12.549ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23082024-11-05T00:00:12.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104279 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48020 req_id = 961b73e0-a14f-4567-aa1f-3f2b851cc4a8 response_code = 204 uri = /switch-ports
23092024-11-05T00:00:12.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36306
23102024-11-05T00:00:12.609ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23112024-11-05T00:00:12.640ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23122024-11-05T00:00:12.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80063 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36306 req_id = 184a19bb-56e9-4fa3-ad90-f6b71ef580cf response_code = 204 uri = /switch-ports
23132024-11-05T00:00:12.690ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48170
23142024-11-05T00:00:12.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36306 req_id = e8bbf816-cdef-4634-8bb2-bf023a23e1fb response_code = 200 uri = /network-bootstore-config
23152024-11-05T00:00:12.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48020 req_id = 38fc84f6-ce1b-4a1f-aee8-2a6b52dad792 response_code = 200 uri = /network-bootstore-config
23162024-11-05T00:00:12.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48170 req_id = 8c269b17-ef0b-4dce-8133-dfe82c17a3d2 response_code = 200 uri = /vpc-routes
23172024-11-05T00:00:12.704ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
23182024-11-05T00:00:12.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48170 req_id = 3ac0b341-7c26-434b-a442-d74c0bfe76f4 response_code = 204 uri = /eip-gateways
23192024-11-05T00:00:12.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48170 req_id = aa665b39-2e6a-473a-8ccf-00ea2b8aa5d2 response_code = 204 uri = /vpc-routes
23202024-11-05T00:00:12.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37464
23212024-11-05T00:00:12.736ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23222024-11-05T00:00:12.771ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23232024-11-05T00:00:12.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90265 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37464 req_id = 0b5185d4-8179-46c2-9927-6c60ad41b654 response_code = 204 uri = /switch-ports
23242024-11-05T00:00:12.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38760
23252024-11-05T00:00:12.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38760 req_id = 6acac0f9-b48c-4c40-9b5b-059c206b9ec2 response_code = 200 uri = /v2p
23262024-11-05T00:00:12.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37464 req_id = 05af89e3-f694-432c-9a22-00e5f40f1b62 response_code = 200 uri = /network-bootstore-config
23272024-11-05T00:00:15.594ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58123
23282024-11-05T00:00:15.594ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58123 req_id = 0a9d3fb8-1d35-4449-9072-e0ede85b7950 response_code = 200 uri = /baseboard
23292024-11-05T00:00:39.086ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23302024-11-05T00:00:39.086ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
23312024-11-05T00:00:39.119ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 3282, tv_nsec: 707776150 } time_to_next_cleanup = 599.99999579s
23322024-11-05T00:00:42.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48747
23332024-11-05T00:00:42.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48747 req_id = 8ae1fc64-59c4-4802-8986-62bfc61532f5 response_code = 200 uri = /vpc-routes
23342024-11-05T00:00:42.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52223
23352024-11-05T00:00:42.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52223 req_id = a52bce31-ca69-406b-87f9-23ef208044dd response_code = 200 uri = /v2p
23362024-11-05T00:00:42.527ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
23372024-11-05T00:00:42.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48747 req_id = 0371260c-c188-427a-ada7-042213f10b58 response_code = 204 uri = /eip-gateways
23382024-11-05T00:00:42.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57992
23392024-11-05T00:00:42.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57992 req_id = 1e435e10-1153-4c81-b7f7-035bb9cee339 response_code = 200 uri = /v2p
23402024-11-05T00:00:42.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48747 req_id = c604529f-3b40-4b0a-9e27-c6e293087aaa response_code = 204 uri = /vpc-routes
23412024-11-05T00:00:42.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54645
23422024-11-05T00:00:42.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54645 req_id = 5f7e4793-14d2-4a80-af7d-4688e1294f19 response_code = 200 uri = /vpc-routes
23432024-11-05T00:00:42.691ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
23442024-11-05T00:00:42.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54645 req_id = 97857b9f-9c7a-451a-863e-134a202a69f0 response_code = 204 uri = /eip-gateways
23452024-11-05T00:00:42.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54645 req_id = cab54034-c32a-46fc-a5b2-e49aa1bb373f response_code = 204 uri = /vpc-routes
23462024-11-05T00:00:42.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50706
23472024-11-05T00:00:42.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50706 req_id = 9f4aee62-a469-42a2-89d9-2953e5a644a7 response_code = 200 uri = /vpc-routes
23482024-11-05T00:00:42.772ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
23492024-11-05T00:00:42.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50706 req_id = 5e118471-c357-498d-b55f-98ba488da0fd response_code = 204 uri = /eip-gateways
23502024-11-05T00:00:42.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50706 req_id = 719f038e-fbd1-4cad-aa84-61b1383f85ef response_code = 204 uri = /vpc-routes
23512024-11-05T00:00:42.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61472
23522024-11-05T00:00:42.822ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23532024-11-05T00:00:42.870ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23542024-11-05T00:00:42.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112539 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61472 req_id = 82072f45-a0f9-4065-aa30-53ef06811804 response_code = 204 uri = /switch-ports
23552024-11-05T00:00:42.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37054
23562024-11-05T00:00:42.935ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23572024-11-05T00:00:42.971ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23582024-11-05T00:00:43.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96106 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37054 req_id = cec78eaa-7482-499d-b71b-898fe3eca1ed response_code = 204 uri = /switch-ports
23592024-11-05T00:00:43.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38184
23602024-11-05T00:00:43.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44380
23612024-11-05T00:00:43.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37054 req_id = 390498ef-9a53-4b92-b154-5b25d5229181 response_code = 200 uri = /network-bootstore-config
23622024-11-05T00:00:43.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61472 req_id = 120e503b-ede6-4960-8194-bf333780db27 response_code = 200 uri = /network-bootstore-config
23632024-11-05T00:00:43.032ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23642024-11-05T00:00:43.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38184 req_id = a8e7f031-0c37-4b9a-a7cb-7b7e8c8017b9 response_code = 200 uri = /v2p
23652024-11-05T00:00:43.071ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23662024-11-05T00:00:43.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96143 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44380 req_id = 3288f6df-b8b3-4595-a7ed-ccea3dc21095 response_code = 204 uri = /switch-ports
23672024-11-05T00:00:43.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44380 req_id = ff83164e-3d36-4dbf-bf6b-2e206a355435 response_code = 200 uri = /network-bootstore-config
23682024-11-05T00:00:45.626ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61475
23692024-11-05T00:00:45.626ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61475 req_id = 77c55de9-ba4a-48bc-984c-c159db36142d response_code = 200 uri = /baseboard
23702024-11-05T00:00:53.396ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23712024-11-05T00:01:12.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44932
23722024-11-05T00:01:12.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44932 req_id = ba834a27-70bc-4b35-99b5-841523f0e824 response_code = 200 uri = /vpc-routes
23732024-11-05T00:01:12.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41007
23742024-11-05T00:01:12.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41007 req_id = 24d5cf03-5138-487e-85c6-1f1b918366ca response_code = 200 uri = /vpc-routes
23752024-11-05T00:01:12.444ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
23762024-11-05T00:01:12.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44932 req_id = d2d0bae6-6e1b-45e8-a294-c2bf52155d11 response_code = 204 uri = /eip-gateways
23772024-11-05T00:01:12.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49582
23782024-11-05T00:01:12.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49582 req_id = d82dce1f-7208-4c82-a5c2-7aff8526be23 response_code = 200 uri = /v2p
23792024-11-05T00:01:12.486ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
23802024-11-05T00:01:12.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41007 req_id = bf30bf79-7bc3-4baf-bfef-fde1991664d0 response_code = 204 uri = /eip-gateways
23812024-11-05T00:01:12.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44932 req_id = a8bcb14e-551f-4bb8-ab57-89eda70a1ced response_code = 204 uri = /vpc-routes
23822024-11-05T00:01:12.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41007 req_id = ff8232a4-a139-4ad0-9d5f-2aa3814af754 response_code = 204 uri = /vpc-routes
23832024-11-05T00:01:12.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65375
23842024-11-05T00:01:12.531ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23852024-11-05T00:01:12.583ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23862024-11-05T00:01:12.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138552 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65375 req_id = 22c95074-2fd8-4fc4-bcf9-df04a926614a response_code = 204 uri = /switch-ports
23872024-11-05T00:01:12.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39405
23882024-11-05T00:01:12.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33730
23892024-11-05T00:01:12.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62343
23902024-11-05T00:01:12.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65375 req_id = 800b8eae-3442-47bc-b92e-710abe1d1553 response_code = 200 uri = /network-bootstore-config
23912024-11-05T00:01:12.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62343 req_id = 23c9202e-8a6d-446a-b505-d323eab2d668 response_code = 200 uri = /vpc-routes
23922024-11-05T00:01:12.670ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23932024-11-05T00:01:12.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33730 req_id = 08687988-2e45-4dc1-bc71-2e46b7705c6b response_code = 200 uri = /v2p
23942024-11-05T00:01:12.726ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
23952024-11-05T00:01:12.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62343 req_id = d772bcc2-0e02-4fd2-aac9-862c31365fa3 response_code = 204 uri = /eip-gateways
23962024-11-05T00:01:12.731ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23972024-11-05T00:01:12.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 463 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62343 req_id = d35ea48e-5c38-4242-9b76-d9091ffb1e86 response_code = 204 uri = /vpc-routes
23982024-11-05T00:01:12.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52481
23992024-11-05T00:01:12.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 148108 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39405 req_id = d479b42d-22d5-4725-b752-0cfea84f5f39 response_code = 204 uri = /switch-ports
24002024-11-05T00:01:12.822ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24012024-11-05T00:01:12.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1001 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39405 req_id = 8eeafefe-c399-4ace-b328-690118ad4eba response_code = 200 uri = /network-bootstore-config
24022024-11-05T00:01:12.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47189
24032024-11-05T00:01:12.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47189 req_id = 4b787076-5075-49aa-9d15-854c46a8ef1a response_code = 200 uri = /v2p
24042024-11-05T00:01:12.869ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24052024-11-05T00:01:12.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171995 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52481 req_id = 4a5f40e8-2be6-4190-a980-becddbee3266 response_code = 204 uri = /switch-ports
24062024-11-05T00:01:12.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52481 req_id = ccd51398-217f-41b2-906e-f42d54a5be4e response_code = 200 uri = /network-bootstore-config
24072024-11-05T00:01:15.659ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46569
24082024-11-05T00:01:15.659ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46569 req_id = 4322f884-9de6-4602-9855-0f8cab85b352 response_code = 200 uri = /baseboard
24092024-11-05T00:01:42.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55978
24102024-11-05T00:01:42.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55978 req_id = 81773e16-f6a0-4d88-a782-079a9ed815b2 response_code = 200 uri = /vpc-routes
24112024-11-05T00:01:42.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64455
24122024-11-05T00:01:42.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64455 req_id = f656797e-f90c-47bd-ac77-e61ac2b881f2 response_code = 200 uri = /vpc-routes
24132024-11-05T00:01:42.531ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
24142024-11-05T00:01:42.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55978 req_id = e1b7282b-641d-4ea0-a4eb-362b65817fbe response_code = 204 uri = /eip-gateways
24152024-11-05T00:01:42.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55978 req_id = 3f7ecebb-7e29-478b-b88f-14b0089b7a72 response_code = 204 uri = /vpc-routes
24162024-11-05T00:01:42.609ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
24172024-11-05T00:01:42.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64455 req_id = 7b288b91-6b8d-4eb4-91c0-f5a6dde9bfe9 response_code = 204 uri = /eip-gateways
24182024-11-05T00:01:42.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64455 req_id = d401fbfd-182b-420a-9108-042dbafc7416 response_code = 204 uri = /vpc-routes
24192024-11-05T00:01:42.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32945
24202024-11-05T00:01:42.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32945 req_id = ef936161-217e-4700-98bd-e98358c424b1 response_code = 200 uri = /v2p
24212024-11-05T00:01:42.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62620
24222024-11-05T00:01:42.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62620 req_id = d5e20294-b0fb-493f-9665-e981585a5cf6 response_code = 200 uri = /v2p
24232024-11-05T00:01:42.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54844
24242024-11-05T00:01:42.737ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24252024-11-05T00:01:42.782ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24262024-11-05T00:01:42.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119086 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54844 req_id = 0c5dbeb5-e013-4ee9-9b29-7881e6759b8b response_code = 204 uri = /switch-ports
24272024-11-05T00:01:42.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41130
24282024-11-05T00:01:42.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62128
24292024-11-05T00:01:42.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62128 req_id = 43e8d517-70f8-4e9d-be15-8d0b99a506a8 response_code = 200 uri = /vpc-routes
24302024-11-05T00:01:42.857ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24312024-11-05T00:01:42.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54844 req_id = 4a8682bb-2c85-449a-81d1-31c7417b763e response_code = 200 uri = /network-bootstore-config
24322024-11-05T00:01:42.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35027
24332024-11-05T00:01:42.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35027 req_id = c6a38d07-5888-415e-bddf-433be2940e2b response_code = 200 uri = /v2p
24342024-11-05T00:01:42.898ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
24352024-11-05T00:01:42.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62128 req_id = 64c12efb-8afa-4b5a-8b0a-5c83f3644dd6 response_code = 204 uri = /eip-gateways
24362024-11-05T00:01:42.899ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24372024-11-05T00:01:42.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62128 req_id = 19371361-39d4-42b5-ba7f-da25826274ab response_code = 204 uri = /vpc-routes
24382024-11-05T00:01:42.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34743
24392024-11-05T00:01:42.963ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24402024-11-05T00:01:42.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106274 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41130 req_id = baf32a5f-1b63-42b2-b7b9-2bc18449b1a2 response_code = 204 uri = /switch-ports
24412024-11-05T00:01:42.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 673 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41130 req_id = 73faeca8-ae5c-4ac0-8d75-5d60a826c4ed response_code = 200 uri = /network-bootstore-config
24422024-11-05T00:01:42.999ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24432024-11-05T00:01:43.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 148944 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34743 req_id = b8fde6e6-fd06-479a-bc7d-35b055a7e3c6 response_code = 204 uri = /switch-ports
24442024-11-05T00:01:43.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34743 req_id = 67058552-407e-474f-bf5f-1ecbc3d21b34 response_code = 200 uri = /network-bootstore-config
24452024-11-05T00:01:45.694ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37623
24462024-11-05T00:01:45.695ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 26 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37623 req_id = e27c7705-1b18-4217-8ac0-a45e7f1310af response_code = 200 uri = /baseboard
24472024-11-05T00:01:47.967ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24482024-11-05T00:01:47.970ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24492024-11-05T00:01:57.971ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24502024-11-05T00:01:57.971ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24512024-11-05T00:01:57.972ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24522024-11-05T00:01:57.975ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24532024-11-05T00:02:07.974ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24542024-11-05T00:02:07.975ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24552024-11-05T00:02:07.975ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24562024-11-05T00:02:07.979ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24572024-11-05T00:02:12.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44110
24582024-11-05T00:02:12.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44110 req_id = ef0abc2e-652a-4bb4-a921-b42a3a00e35e response_code = 200 uri = /vpc-routes
24592024-11-05T00:02:12.381ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
24602024-11-05T00:02:12.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44110 req_id = 640a991b-d0c3-4df6-bbb4-98b7727375d2 response_code = 204 uri = /eip-gateways
24612024-11-05T00:02:12.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44110 req_id = cd36bb5b-f263-43c7-b3d6-c610d16df5ac response_code = 204 uri = /vpc-routes
24622024-11-05T00:02:12.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34885
24632024-11-05T00:02:12.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34885 req_id = 5501690e-4616-4384-ba08-de1912413c93 response_code = 200 uri = /vpc-routes
24642024-11-05T00:02:12.450ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
24652024-11-05T00:02:12.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34885 req_id = dc126e7e-4b9e-4d54-8397-b4d9ca6b2509 response_code = 204 uri = /eip-gateways
24662024-11-05T00:02:12.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55583
24672024-11-05T00:02:12.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55583 req_id = 1bc58e5a-013f-4603-91f9-88585ce8a8f5 response_code = 200 uri = /v2p
24682024-11-05T00:02:12.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34885 req_id = e6b2c2db-a434-4c55-a7fc-28ec63b8dd90 response_code = 204 uri = /vpc-routes
24692024-11-05T00:02:12.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53304
24702024-11-05T00:02:12.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53304 req_id = 91d1b417-caf6-4abe-8283-75853fee737f response_code = 200 uri = /v2p
24712024-11-05T00:02:12.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38491
24722024-11-05T00:02:12.546ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24732024-11-05T00:02:12.592ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24742024-11-05T00:02:12.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109990 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38491 req_id = 2ea21fc5-5efc-4a69-aa90-d362de59a83e response_code = 204 uri = /switch-ports
24752024-11-05T00:02:12.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43624
24762024-11-05T00:02:12.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61762
24772024-11-05T00:02:12.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61762 req_id = 6867700a-e5bb-49ff-ab4b-53baed503699 response_code = 200 uri = /vpc-routes
24782024-11-05T00:02:12.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38491 req_id = a964de76-ca31-40c3-b43f-2ffa8c5fcbd7 response_code = 200 uri = /network-bootstore-config
24792024-11-05T00:02:12.657ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24802024-11-05T00:02:12.703ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
24812024-11-05T00:02:12.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61762 req_id = b1c18afd-b28c-4951-a862-c0e6c5aee711 response_code = 204 uri = /eip-gateways
24822024-11-05T00:02:12.705ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24832024-11-05T00:02:12.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54146
24842024-11-05T00:02:12.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61762 req_id = 82211ac6-8611-45f7-9f55-3b70e8e6df30 response_code = 204 uri = /vpc-routes
24852024-11-05T00:02:12.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117302 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43624 req_id = 2d415635-8bb7-4226-a527-ce71bbf8fc17 response_code = 204 uri = /switch-ports
24862024-11-05T00:02:12.774ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24872024-11-05T00:02:12.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 759 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43624 req_id = 61af86c7-c4f8-4a64-981f-5718cb1d7aec response_code = 200 uri = /network-bootstore-config
24882024-11-05T00:02:12.814ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24892024-11-05T00:02:12.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42168
24902024-11-05T00:02:12.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42168 req_id = 3e938d86-8835-4c82-992b-620be9579a80 response_code = 200 uri = /v2p
24912024-11-05T00:02:12.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 165337 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54146 req_id = 118f2237-b2ef-4e77-97c9-07ecc46937ef response_code = 204 uri = /switch-ports
24922024-11-05T00:02:12.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54146 req_id = 378bbfcb-63af-45ed-9a2a-a1f93d6998f1 response_code = 200 uri = /network-bootstore-config
24932024-11-05T00:02:15.727ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50980
24942024-11-05T00:02:15.727ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 26 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50980 req_id = 80f20ef4-4dad-4aec-9519-392638262db5 response_code = 200 uri = /baseboard
24952024-11-05T00:02:17.978ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24962024-11-05T00:02:17.979ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24972024-11-05T00:02:17.980ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24982024-11-05T00:02:17.983ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
24992024-11-05T00:02:27.983ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25002024-11-05T00:02:27.984ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25012024-11-05T00:02:27.984ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25022024-11-05T00:02:27.988ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25032024-11-05T00:02:37.986ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25042024-11-05T00:02:37.987ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25052024-11-05T00:02:37.988ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25062024-11-05T00:02:37.991ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25072024-11-05T00:02:42.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54622
25082024-11-05T00:02:42.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54622 req_id = a91264f9-6062-4d15-9bd4-b418f608a524 response_code = 200 uri = /vpc-routes
25092024-11-05T00:02:42.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52519
25102024-11-05T00:02:42.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52519 req_id = 069256f7-950e-486d-b1fc-5e0ac6e27b02 response_code = 200 uri = /vpc-routes
25112024-11-05T00:02:42.603ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
25122024-11-05T00:02:42.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54622 req_id = 9cfe04a5-76ec-42dc-953f-224fcd34eb9c response_code = 204 uri = /eip-gateways
25132024-11-05T00:02:42.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54622 req_id = f9d546de-d93d-4a7a-b6b8-ae2376b62d16 response_code = 204 uri = /vpc-routes
25142024-11-05T00:02:42.627ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
25152024-11-05T00:02:42.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52519 req_id = b474d4c4-82a2-4ed8-a956-29c3fc6149d4 response_code = 204 uri = /eip-gateways
25162024-11-05T00:02:42.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52519 req_id = 2b983022-cefa-433a-bf87-b8b1799bd0e0 response_code = 204 uri = /vpc-routes
25172024-11-05T00:02:42.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53132
25182024-11-05T00:02:42.762ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25192024-11-05T00:02:42.807ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
25202024-11-05T00:02:42.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105138 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53132 req_id = f2900543-8877-4cbb-86d3-5a91d5e208ad response_code = 204 uri = /switch-ports
25212024-11-05T00:02:42.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34178
25222024-11-05T00:02:42.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64358
25232024-11-05T00:02:42.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47434
25242024-11-05T00:02:42.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47434 req_id = 7c946b0c-865a-4e86-9693-86cef67a9f2f response_code = 200 uri = /v2p
25252024-11-05T00:02:42.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64358 req_id = 56340183-05e6-41f1-98de-c5a2c0a5678c response_code = 200 uri = /v2p
25262024-11-05T00:02:42.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34178 req_id = 969a1b59-8798-4e7e-b4ef-cdd5841b02dc response_code = 200 uri = /vpc-routes
25272024-11-05T00:02:42.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53132 req_id = 0a195767-b3dc-44aa-89ef-fa5ecaa5f09e response_code = 200 uri = /network-bootstore-config
25282024-11-05T00:02:42.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53776
25292024-11-05T00:02:42.869ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25302024-11-05T00:02:42.911ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
25312024-11-05T00:02:42.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100302 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53776 req_id = 0cf6949f-5684-4cff-a51d-feb098ec6642 response_code = 204 uri = /switch-ports
25322024-11-05T00:02:42.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38704
25332024-11-05T00:02:42.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42105
25342024-11-05T00:02:42.970ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
25352024-11-05T00:02:42.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34178 req_id = 42d8eedf-f6a4-4ddd-935a-b27fc90ed719 response_code = 204 uri = /eip-gateways
25362024-11-05T00:02:42.970ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25372024-11-05T00:02:42.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53776 req_id = 14709111-f795-4878-a0c8-d05666349233 response_code = 200 uri = /network-bootstore-config
25382024-11-05T00:02:42.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5505 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38704 req_id = 4f2485ab-6f39-4e1e-a69e-313243924a20 response_code = 200 uri = /v2p
25392024-11-05T00:02:42.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34178 req_id = 63656631-37ba-4dca-8df2-00c72cb6c88b response_code = 204 uri = /vpc-routes
25402024-11-05T00:02:43.013ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
25412024-11-05T00:02:43.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101434 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42105 req_id = 9c71d3cf-07ff-4773-8f1f-4a94384f6808 response_code = 204 uri = /switch-ports
25422024-11-05T00:02:43.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42105 req_id = 837aab1a-749e-45af-8cb3-b83b82b57cce response_code = 200 uri = /network-bootstore-config
25432024-11-05T00:02:45.761ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38783
25442024-11-05T00:02:45.761ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38783 req_id = c0a22a3c-acb7-4301-aeed-592f4a578eba response_code = 200 uri = /baseboard
25452024-11-05T00:02:47.990ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25462024-11-05T00:02:47.991ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25472024-11-05T00:02:47.991ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25482024-11-05T00:02:47.995ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25492024-11-05T00:02:57.993ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25502024-11-05T00:02:57.994ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25512024-11-05T00:02:57.994ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25522024-11-05T00:02:57.998ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25532024-11-05T00:03:07.997ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25542024-11-05T00:03:07.998ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25552024-11-05T00:03:07.998ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25562024-11-05T00:03:08.002ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25572024-11-05T00:03:12.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64550
25582024-11-05T00:03:12.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64550 req_id = 46e24d35-c0ee-4795-a054-f3f38aad51ea response_code = 200 uri = /vpc-routes
25592024-11-05T00:03:12.412ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
25602024-11-05T00:03:12.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64550 req_id = 683dddfd-1ec9-4397-9b4d-c33cf8ab4abe response_code = 204 uri = /eip-gateways
25612024-11-05T00:03:12.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64550 req_id = 7e9fc156-4392-462a-a273-8e4e1b1d8b46 response_code = 204 uri = /vpc-routes
25622024-11-05T00:03:12.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56825
25632024-11-05T00:03:12.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56825 req_id = 39d1182a-9813-4000-8a61-9586c90b687a response_code = 200 uri = /vpc-routes
25642024-11-05T00:03:12.521ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
25652024-11-05T00:03:12.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56825 req_id = 05e976b4-7e83-4bc8-8a4d-ee9f7640e1f6 response_code = 204 uri = /eip-gateways
25662024-11-05T00:03:12.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56825 req_id = 2bff6cea-2811-4a7e-ba97-13312e4773ad response_code = 204 uri = /vpc-routes
25672024-11-05T00:03:12.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52324
25682024-11-05T00:03:12.561ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25692024-11-05T00:03:12.607ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
25702024-11-05T00:03:12.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112712 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52324 req_id = 12f0e875-87a3-4f3d-b33b-0a1dc4fe23f9 response_code = 204 uri = /switch-ports
25712024-11-05T00:03:12.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52470
25722024-11-05T00:03:12.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56772
25732024-11-05T00:03:12.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38299
25742024-11-05T00:03:12.674ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25752024-11-05T00:03:12.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52324 req_id = 7c9428f6-73c1-4958-861d-b0398e9f9284 response_code = 200 uri = /network-bootstore-config
25762024-11-05T00:03:12.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52470 req_id = 5ddf3e10-223e-4f27-8aa9-571c062e2de1 response_code = 200 uri = /vpc-routes
25772024-11-05T00:03:12.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4444 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56772 req_id = 17781687-2dbd-496d-a726-a9c48e5bc777 response_code = 200 uri = /v2p
25782024-11-05T00:03:12.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56336
25792024-11-05T00:03:12.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56336 req_id = d6f25632-e20e-4c84-ad7f-ab2543ff2956 response_code = 200 uri = /v2p
25802024-11-05T00:03:12.714ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
25812024-11-05T00:03:12.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37038
25822024-11-05T00:03:12.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37038 req_id = 546f95bc-bf34-438a-8894-f6b58ebcb802 response_code = 200 uri = /v2p
25832024-11-05T00:03:12.720ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
25842024-11-05T00:03:12.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52470 req_id = 8140320b-f303-4f64-817f-1602711f9193 response_code = 204 uri = /eip-gateways
25852024-11-05T00:03:12.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63030
25862024-11-05T00:03:12.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 749 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52470 req_id = 70d7fa83-8e4c-477e-a336-9c62b271b298 response_code = 204 uri = /vpc-routes
25872024-11-05T00:03:12.775ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25882024-11-05T00:03:12.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101288 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38299 req_id = 6aa4cba6-75c0-4d1e-8f30-ff13d256253d response_code = 204 uri = /switch-ports
25892024-11-05T00:03:12.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38299 req_id = f69dc78d-8233-4d37-ad0c-98b44a7e6a9d response_code = 200 uri = /network-bootstore-config
25902024-11-05T00:03:12.813ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
25912024-11-05T00:03:12.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 148045 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63030 req_id = 92c905cb-de62-46b8-bbc5-f592314bee8f response_code = 204 uri = /switch-ports
25922024-11-05T00:03:12.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63030 req_id = eaae2cd5-746e-4a1d-84d0-bd947ce7eb12 response_code = 200 uri = /network-bootstore-config
25932024-11-05T00:03:15.802ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56285
25942024-11-05T00:03:15.802ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56285 req_id = 15080ef2-d88c-4e5e-9a7a-dfaf3b9c9362 response_code = 200 uri = /baseboard
25952024-11-05T00:03:18.001ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25962024-11-05T00:03:18.002ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25972024-11-05T00:03:18.002ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25982024-11-05T00:03:18.005ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
25992024-11-05T00:03:28.004ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26002024-11-05T00:03:28.005ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26012024-11-05T00:03:28.005ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26022024-11-05T00:03:28.009ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26032024-11-05T00:03:38.008ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26042024-11-05T00:03:38.009ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26052024-11-05T00:03:38.010ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26062024-11-05T00:03:38.013ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26072024-11-05T00:03:42.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62811
26082024-11-05T00:03:42.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62811 req_id = 63ee51e6-e7a2-4970-a88b-8af0e6b33743 response_code = 200 uri = /vpc-routes
26092024-11-05T00:03:42.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40818
26102024-11-05T00:03:42.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40818 req_id = 213bf557-1b33-4f94-945e-ccd4b841271c response_code = 200 uri = /vpc-routes
26112024-11-05T00:03:42.562ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
26122024-11-05T00:03:42.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62811 req_id = 0df946df-ca8e-424f-ab22-87fd1b5d6188 response_code = 204 uri = /eip-gateways
26132024-11-05T00:03:42.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62811 req_id = ee8a7130-0aa6-44e1-bb8a-2d0c666b3338 response_code = 204 uri = /vpc-routes
26142024-11-05T00:03:42.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65413
26152024-11-05T00:03:42.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65413 req_id = 21c00d44-5d1c-40c3-b5e7-4f185d35e4a8 response_code = 200 uri = /v2p
26162024-11-05T00:03:42.610ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
26172024-11-05T00:03:42.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40818 req_id = 608ea7c7-01c5-44f9-8751-cdf927550ab5 response_code = 204 uri = /eip-gateways
26182024-11-05T00:03:42.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40818 req_id = 5787f9ad-8ee9-4a37-9cc8-3c80ef4abf0c response_code = 204 uri = /vpc-routes
26192024-11-05T00:03:42.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39195
26202024-11-05T00:03:42.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39195 req_id = 090b5d59-f74c-4ab6-a813-472bd2ffe21a response_code = 200 uri = /v2p
26212024-11-05T00:03:42.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49541
26222024-11-05T00:03:42.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49541 req_id = 82921024-9f5e-4701-8056-01011e47f02c response_code = 200 uri = /vpc-routes
26232024-11-05T00:03:42.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62569
26242024-11-05T00:03:42.670ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26252024-11-05T00:03:42.717ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26262024-11-05T00:03:42.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117532 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62569 req_id = 80d6d555-0fce-4807-8bd1-498b805beebd response_code = 204 uri = /switch-ports
26272024-11-05T00:03:42.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44879
26282024-11-05T00:03:42.788ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26292024-11-05T00:03:42.788ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
26302024-11-05T00:03:42.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49541 req_id = 1519acea-47d6-423d-bf64-73fb5ef7c0a5 response_code = 204 uri = /eip-gateways
26312024-11-05T00:03:42.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4736 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62569 req_id = 9dce4b48-7f47-40ce-8d7e-e325abfc164d response_code = 200 uri = /network-bootstore-config
26322024-11-05T00:03:42.830ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26332024-11-05T00:03:42.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62351
26342024-11-05T00:03:42.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62351 req_id = ac724880-4ce6-4ad9-8358-b020cc0e7ee7 response_code = 200 uri = /v2p
26352024-11-05T00:03:42.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49541 req_id = 6329d361-128c-46a8-877d-dbcdd7fd35b3 response_code = 204 uri = /vpc-routes
26362024-11-05T00:03:42.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111110 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44879 req_id = 0401ec55-4bd9-4022-9729-aa46324d640d response_code = 204 uri = /switch-ports
26372024-11-05T00:03:42.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44879 req_id = 72146532-91af-4121-8b0d-f34debc4c5b5 response_code = 200 uri = /network-bootstore-config
26382024-11-05T00:03:43.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60331
26392024-11-05T00:03:43.006ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26402024-11-05T00:03:43.051ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26412024-11-05T00:03:43.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111959 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60331 req_id = d74f433f-26c1-41ee-ab2a-be6b156df714 response_code = 204 uri = /switch-ports
26422024-11-05T00:03:43.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60331 req_id = aed01ff3-c4d0-4093-93ad-5514e7505dc6 response_code = 200 uri = /network-bootstore-config
26432024-11-05T00:03:45.837ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33265
26442024-11-05T00:03:45.837ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33265 req_id = f86821f5-c39e-4f5d-bc01-fd9773a3570e response_code = 200 uri = /baseboard
26452024-11-05T00:03:48.011ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26462024-11-05T00:03:48.012ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26472024-11-05T00:03:48.013ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26482024-11-05T00:03:48.016ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26492024-11-05T00:03:58.015ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26502024-11-05T00:03:58.016ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26512024-11-05T00:03:58.016ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26522024-11-05T00:03:58.020ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26532024-11-05T00:04:08.019ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26542024-11-05T00:04:08.020ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26552024-11-05T00:04:08.021ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26562024-11-05T00:04:08.024ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26572024-11-05T00:04:12.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32935
26582024-11-05T00:04:12.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32935 req_id = d04951ab-4027-4638-8a38-9744fba25f73 response_code = 200 uri = /v2p
26592024-11-05T00:04:12.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39498
26602024-11-05T00:04:12.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39498 req_id = 5a70ee28-a4cd-4e58-aa70-80514add9624 response_code = 200 uri = /vpc-routes
26612024-11-05T00:04:12.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44070
26622024-11-05T00:04:12.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44070 req_id = b1f8f340-b4f3-4668-bde5-19ec8d72a10b response_code = 200 uri = /v2p
26632024-11-05T00:04:12.432ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
26642024-11-05T00:04:12.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39498 req_id = 9e635b40-b0b4-442e-ab8b-62219a542593 response_code = 204 uri = /eip-gateways
26652024-11-05T00:04:12.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39498 req_id = 464189e6-0854-4cf6-bfdc-c6ecb4b2296e response_code = 204 uri = /vpc-routes
26662024-11-05T00:04:12.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63940
26672024-11-05T00:04:12.494ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26682024-11-05T00:04:12.538ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26692024-11-05T00:04:12.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109550 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63940 req_id = 48fe61ae-db92-41e3-8384-03bdb77b9042 response_code = 204 uri = /switch-ports
26702024-11-05T00:04:12.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37064
26712024-11-05T00:04:12.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62447
26722024-11-05T00:04:12.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62447 req_id = dcb2ec2d-fb41-465d-b1cf-12a2f15de178 response_code = 200 uri = /vpc-routes
26732024-11-05T00:04:12.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63940 req_id = 67453ce6-a351-4a7f-a122-f063bf7622e9 response_code = 200 uri = /network-bootstore-config
26742024-11-05T00:04:12.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37064 req_id = e7456706-3e03-4389-9ab8-97bcd927891e response_code = 200 uri = /vpc-routes
26752024-11-05T00:04:12.619ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
26762024-11-05T00:04:12.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37064 req_id = 41d0f152-5bc6-4b52-8125-c400398dbeba response_code = 204 uri = /eip-gateways
26772024-11-05T00:04:12.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39124
26782024-11-05T00:04:12.621ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26792024-11-05T00:04:12.667ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26802024-11-05T00:04:12.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107867 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39124 req_id = 52cf3d9d-11c9-4dd7-99a1-16bebc014fc5 response_code = 204 uri = /switch-ports
26812024-11-05T00:04:12.729ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
26822024-11-05T00:04:12.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62447 req_id = 45168ab0-d576-4534-ac77-146878046243 response_code = 204 uri = /eip-gateways
26832024-11-05T00:04:12.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 347 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37064 req_id = 7925ee7a-b7de-402d-901d-a08cbdef8952 response_code = 204 uri = /vpc-routes
26842024-11-05T00:04:12.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39124 req_id = d012e29b-f652-48f8-8beb-fa91c27af98a response_code = 200 uri = /network-bootstore-config
26852024-11-05T00:04:12.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62447 req_id = 9fa88908-50ae-4834-8090-7775f0dc73dc response_code = 204 uri = /vpc-routes
26862024-11-05T00:04:12.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52454
26872024-11-05T00:04:12.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52454 req_id = ceb0c09b-0beb-4eae-9394-048e35a7f180 response_code = 200 uri = /v2p
26882024-11-05T00:04:12.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45863
26892024-11-05T00:04:12.801ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26902024-11-05T00:04:12.841ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26912024-11-05T00:04:12.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101243 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45863 req_id = 60119841-c039-4408-9778-cb3b8e0a69fe response_code = 204 uri = /switch-ports
26922024-11-05T00:04:12.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45863 req_id = c938e9ad-dd12-4467-b257-c8e98dd22273 response_code = 200 uri = /network-bootstore-config
26932024-11-05T00:04:15.872ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44514
26942024-11-05T00:04:15.872ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44514 req_id = 1ba34e33-8630-43b2-8726-60700fb04eed response_code = 200 uri = /baseboard
26952024-11-05T00:04:18.023ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26962024-11-05T00:04:18.024ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26972024-11-05T00:04:18.025ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26982024-11-05T00:04:18.028ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
26992024-11-05T00:04:28.027ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27002024-11-05T00:04:28.027ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27012024-11-05T00:04:28.028ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27022024-11-05T00:04:28.031ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27032024-11-05T00:04:38.030ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27042024-11-05T00:04:38.031ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27052024-11-05T00:04:38.031ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27062024-11-05T00:04:38.035ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27072024-11-05T00:04:42.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36750
27082024-11-05T00:04:42.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36750 req_id = 10d0d865-0618-456d-8ba4-849cde27de24 response_code = 200 uri = /vpc-routes
27092024-11-05T00:04:42.520ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
27102024-11-05T00:04:42.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36750 req_id = bd8b61e0-aee9-4da4-807c-e7c24d0f7fbd response_code = 204 uri = /eip-gateways
27112024-11-05T00:04:42.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57852
27122024-11-05T00:04:42.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57852 req_id = cd3dbc6b-33c6-44dc-84db-b249f6e05e35 response_code = 200 uri = /v2p
27132024-11-05T00:04:42.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55700
27142024-11-05T00:04:42.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55700 req_id = 6592e6b4-e7fc-4aba-9ca9-0e75bf065c30 response_code = 200 uri = /vpc-routes
27152024-11-05T00:04:42.663ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
27162024-11-05T00:04:42.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55700 req_id = 6b7cb5bf-e6e6-46c6-be35-d622b7532c9b response_code = 204 uri = /eip-gateways
27172024-11-05T00:04:42.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55700 req_id = c8f12ca5-4626-4f90-b9e7-6df765b51452 response_code = 204 uri = /vpc-routes
27182024-11-05T00:04:42.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60229
27192024-11-05T00:04:42.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60229 req_id = 3c58511b-0c81-43f9-aca6-038c4c68aacf response_code = 200 uri = /v2p
27202024-11-05T00:04:42.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36750 req_id = 0e7ddfd3-8a16-4d36-bd59-2775aecf410c response_code = 204 uri = /vpc-routes
27212024-11-05T00:04:42.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42960
27222024-11-05T00:04:42.793ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27232024-11-05T00:04:42.842ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
27242024-11-05T00:04:42.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134454 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42960 req_id = a0bfe181-6f8b-4b8a-b13d-53ad79a72f75 response_code = 204 uri = /switch-ports
27252024-11-05T00:04:42.928ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38118
27262024-11-05T00:04:42.928ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53485
27272024-11-05T00:04:42.928ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39401
27282024-11-05T00:04:42.928ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54055
27292024-11-05T00:04:42.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53485 req_id = 5817da0b-de46-4d46-a1e4-34c503f8c21b response_code = 200 uri = /vpc-routes
27302024-11-05T00:04:42.928ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
27312024-11-05T00:04:42.928ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
27322024-11-05T00:04:42.928ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7155d12f-56d4-469c-89f3-97766104983b, kind: Service { id: d840e2fc-5a49-44c2-87c1-9190f4e47113 }, name: Name("external-dns-d840e2fc-5a49-44c2-87c1-9190f4e47113"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da209965-7111-4076-a7e7-ba8fb40d3572, kind: Service { id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295 }, name: Name("external-dns-5f4c9dd5-dad6-4fc2-ba58-b064adbea295"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b3056cef-70ef-4c2c-9b47-f29485e812ed, kind: Service { id: 3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd }, name: Name("nexus-3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e75b87c5-0d01-4e92-b145-05ce8da9b4ce, kind: Service { id: 2bc59dd6-be0a-4755-adc1-2be053a1e284 }, name: Name("nexus-2bc59dd6-be0a-4755-adc1-2be053a1e284"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ee017e11-2d79-4135-9b0e-ae0d2aaa0345, kind: Service { id: 96aa1415-4c39-4ede-a09d-b8326a8455f7 }, name: Name("nexus-96aa1415-4c39-4ede-a09d-b8326a8455f7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27332024-11-05T00:04:42.928ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27342024-11-05T00:04:42.928ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/omicron-zones.json file = common/src/ledger.rs:177
27352024-11-05T00:04:42.928ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27362024-11-05T00:04:42.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42960 req_id = 317592f5-fbcc-4de9-a376-a42196967bcf response_code = 200 uri = /network-bootstore-config
27372024-11-05T00:04:42.928ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27382024-11-05T00:04:42.928ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27392024-11-05T00:04:42.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27402024-11-05T00:04:42.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27412024-11-05T00:04:42.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27422024-11-05T00:04:42.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7426 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54055 req_id = ff306c99-12aa-4659-b01a-ac5e56087873 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27432024-11-05T00:04:42.936ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/omicron-zones.json file = common/src/ledger.rs:177
27442024-11-05T00:04:42.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59462
27452024-11-05T00:04:42.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51570
27462024-11-05T00:04:42.962ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7155d12f-56d4-469c-89f3-97766104983b, kind: Service { id: d840e2fc-5a49-44c2-87c1-9190f4e47113 }, name: Name("external-dns-d840e2fc-5a49-44c2-87c1-9190f4e47113"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da209965-7111-4076-a7e7-ba8fb40d3572, kind: Service { id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295 }, name: Name("external-dns-5f4c9dd5-dad6-4fc2-ba58-b064adbea295"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b3056cef-70ef-4c2c-9b47-f29485e812ed, kind: Service { id: 3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd }, name: Name("nexus-3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e75b87c5-0d01-4e92-b145-05ce8da9b4ce, kind: Service { id: 2bc59dd6-be0a-4755-adc1-2be053a1e284 }, name: Name("nexus-2bc59dd6-be0a-4755-adc1-2be053a1e284"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ee017e11-2d79-4135-9b0e-ae0d2aaa0345, kind: Service { id: 96aa1415-4c39-4ede-a09d-b8326a8455f7 }, name: Name("nexus-96aa1415-4c39-4ede-a09d-b8326a8455f7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27472024-11-05T00:04:42.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27482024-11-05T00:04:42.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27492024-11-05T00:04:42.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27502024-11-05T00:04:42.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27512024-11-05T00:04:42.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27522024-11-05T00:04:42.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27532024-11-05T00:04:42.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51570 req_id = 72768302-9b51-45c3-87ac-c0f31efeb684 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27542024-11-05T00:04:42.976ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
27552024-11-05T00:04:42.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 660 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53485 req_id = 36490c54-8aed-4e39-91ca-b144baafa234 response_code = 204 uri = /eip-gateways
27562024-11-05T00:04:42.979ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
27572024-11-05T00:04:42.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62360
27582024-11-05T00:04:42.999ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
27592024-11-05T00:04:42.999ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
27602024-11-05T00:04:42.999ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/omicron-zones.json file = common/src/ledger.rs:177
27612024-11-05T00:04:43.000ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/omicron-zones.json file = common/src/ledger.rs:177
27622024-11-05T00:04:43.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5565 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53485 req_id = d696b9ee-00d1-411e-a852-b8c85d864fd8 response_code = 204 uri = /vpc-routes
27632024-11-05T00:04:43.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53920
27642024-11-05T00:04:43.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53920 req_id = 85c6f90a-d554-43fd-b4cd-03391594e177 response_code = 200 uri = /v2p
27652024-11-05T00:04:43.068ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27662024-11-05T00:04:43.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140414 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38118 req_id = a0cdbc74-bff5-4a5d-9b5d-8554ae08f99d response_code = 204 uri = /switch-ports
27672024-11-05T00:04:43.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38118 req_id = ec76ec69-3c83-4959-ab62-5533fe1351b0 response_code = 200 uri = /network-bootstore-config
27682024-11-05T00:04:43.115ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
27692024-11-05T00:04:43.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 248675 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59462 req_id = 14e38706-cf80-462c-a233-7d0d2fbc2f63 response_code = 204 uri = /switch-ports
27702024-11-05T00:04:43.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59462 req_id = a9e9cc09-d6a1-4432-a89f-a187ce92066b response_code = 200 uri = /network-bootstore-config
27712024-11-05T00:04:43.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 291958 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39401 req_id = 67c2a2e9-8047-4fc7-ab41-dea096e98e75 response_code = 200 uri = /inventory
27722024-11-05T00:04:43.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55612
27732024-11-05T00:04:43.281ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7155d12f-56d4-469c-89f3-97766104983b, kind: Service { id: d840e2fc-5a49-44c2-87c1-9190f4e47113 }, name: Name("external-dns-d840e2fc-5a49-44c2-87c1-9190f4e47113"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da209965-7111-4076-a7e7-ba8fb40d3572, kind: Service { id: 5f4c9dd5-dad6-4fc2-ba58-b064adbea295 }, name: Name("external-dns-5f4c9dd5-dad6-4fc2-ba58-b064adbea295"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 186])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b3056cef-70ef-4c2c-9b47-f29485e812ed, kind: Service { id: 3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd }, name: Name("nexus-3febeba9-76ae-4ef5-87bf-91f2ed2b4cfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 205])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e75b87c5-0d01-4e92-b145-05ce8da9b4ce, kind: Service { id: 2bc59dd6-be0a-4755-adc1-2be053a1e284 }, name: Name("nexus-2bc59dd6-be0a-4755-adc1-2be053a1e284"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ee017e11-2d79-4135-9b0e-ae0d2aaa0345, kind: Service { id: 96aa1415-4c39-4ede-a09d-b8326a8455f7 }, name: Name("nexus-96aa1415-4c39-4ede-a09d-b8326a8455f7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27742024-11-05T00:04:43.281ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27752024-11-05T00:04:43.281ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27762024-11-05T00:04:43.281ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27772024-11-05T00:04:43.281ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27782024-11-05T00:04:43.281ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27792024-11-05T00:04:43.281ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27802024-11-05T00:04:43.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55612 req_id = 1ea5b01d-eb77-4e08-af27-c0145123236d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27812024-11-05T00:04:43.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 285000 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62360 req_id = acf8be79-2387-4d5f-8339-01ee3a773cd3 response_code = 200 uri = /inventory
27822024-11-05T00:04:43.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34296
27832024-11-05T00:04:43.729ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
27842024-11-05T00:04:43.729ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
27852024-11-05T00:04:43.729ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/config/omicron-zones.json file = common/src/ledger.rs:177
27862024-11-05T00:04:43.729ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/config/omicron-zones.json file = common/src/ledger.rs:177
27872024-11-05T00:04:43.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 218892 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34296 req_id = 8b05a690-22b8-498a-bc48-dc967ee9687c response_code = 200 uri = /inventory
27882024-11-05T00:04:45.906ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37435
27892024-11-05T00:04:45.906ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37435 req_id = dc964103-3a67-4251-8aee-c61a841034d7 response_code = 200 uri = /baseboard
27902024-11-05T00:04:48.034ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27912024-11-05T00:04:48.034ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27922024-11-05T00:04:48.035ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27932024-11-05T00:04:48.038ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27942024-11-05T00:04:58.037ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27952024-11-05T00:04:58.038ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27962024-11-05T00:04:58.038ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27972024-11-05T00:04:58.042ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27982024-11-05T00:05:08.040ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
27992024-11-05T00:05:08.041ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28002024-11-05T00:05:08.042ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28012024-11-05T00:05:08.046ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28022024-11-05T00:05:12.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56301
28032024-11-05T00:05:12.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56301 req_id = 19122335-1348-4d63-8224-9cc0da0512a1 response_code = 200 uri = /v2p
28042024-11-05T00:05:12.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46043
28052024-11-05T00:05:12.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46043 req_id = 74c11f5c-5b36-425c-8477-cb53bb5da95f response_code = 200 uri = /vpc-routes
28062024-11-05T00:05:12.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41234
28072024-11-05T00:05:12.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41234 req_id = 0a2e0781-2190-492e-9081-6087ee422cec response_code = 200 uri = /vpc-routes
28082024-11-05T00:05:12.405ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
28092024-11-05T00:05:12.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46043 req_id = 81e28267-f657-49c0-9583-256ebb586816 response_code = 204 uri = /eip-gateways
28102024-11-05T00:05:12.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46043 req_id = 0396efc8-c829-4f57-8b13-5aebf727c192 response_code = 204 uri = /vpc-routes
28112024-11-05T00:05:12.453ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
28122024-11-05T00:05:12.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41234 req_id = d11ebbde-4715-4614-ba73-be8110ddfffb response_code = 204 uri = /eip-gateways
28132024-11-05T00:05:12.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41234 req_id = 33a2dc54-7aa4-4937-a111-29e5ac52ede6 response_code = 204 uri = /vpc-routes
28142024-11-05T00:05:12.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59102
28152024-11-05T00:05:12.498ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
28162024-11-05T00:05:12.546ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28172024-11-05T00:05:12.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117404 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59102 req_id = 60de4ff5-441b-4eac-a372-902a6c6de2b8 response_code = 204 uri = /switch-ports
28182024-11-05T00:05:12.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59568
28192024-11-05T00:05:12.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64195
28202024-11-05T00:05:12.615ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
28212024-11-05T00:05:12.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4578 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59102 req_id = 3e6d5883-5c54-42ab-9c0a-7c37d0f5cca3 response_code = 200 uri = /network-bootstore-config
28222024-11-05T00:05:12.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53696
28232024-11-05T00:05:12.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4779 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59568 req_id = 0c199e48-33e0-4860-8a78-0f3894af27a3 response_code = 200 uri = /v2p
28242024-11-05T00:05:12.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53696 req_id = 5c311ba8-b57f-4840-a037-6cbbb90ab247 response_code = 200 uri = /vpc-routes
28252024-11-05T00:05:12.637ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
28262024-11-05T00:05:12.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53696 req_id = d510333d-79f5-441d-843b-8266cf11d822 response_code = 204 uri = /eip-gateways
28272024-11-05T00:05:12.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41340
28282024-11-05T00:05:12.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 892 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53696 req_id = fec5b135-5688-473f-8957-d561f6fa66bf response_code = 204 uri = /vpc-routes
28292024-11-05T00:05:12.660ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28302024-11-05T00:05:12.727ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
28312024-11-05T00:05:12.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112188 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64195 req_id = 14f2787e-0575-4e30-b287-65a5bba8be06 response_code = 204 uri = /switch-ports
28322024-11-05T00:05:12.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 698 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64195 req_id = 6ad99dc7-309c-4191-bd31-425f0181cc3b response_code = 200 uri = /network-bootstore-config
28332024-11-05T00:05:12.766ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28342024-11-05T00:05:12.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43055
28352024-11-05T00:05:12.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43055 req_id = d0fc76c5-f8cf-4b3e-a570-e204763a118a response_code = 200 uri = /v2p
28362024-11-05T00:05:12.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 184937 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41340 req_id = c6629761-a01c-4e58-97b8-db112f919208 response_code = 204 uri = /switch-ports
28372024-11-05T00:05:12.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41340 req_id = 00b9c8b6-411e-44bd-9a89-74beb2714fb6 response_code = 200 uri = /network-bootstore-config
28382024-11-05T00:05:15.942ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39595
28392024-11-05T00:05:15.942ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39595 req_id = 84dbd175-a8e6-4077-b53c-d8d054f8031d response_code = 200 uri = /baseboard
28402024-11-05T00:05:18.045ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28412024-11-05T00:05:18.046ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28422024-11-05T00:05:18.046ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28432024-11-05T00:05:18.050ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28442024-11-05T00:05:28.049ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28452024-11-05T00:05:28.049ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28462024-11-05T00:05:28.050ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28472024-11-05T00:05:28.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28482024-11-05T00:05:38.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28492024-11-05T00:05:38.054ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28502024-11-05T00:05:38.055ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28512024-11-05T00:05:38.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28522024-11-05T00:05:42.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40060
28532024-11-05T00:05:42.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40060 req_id = bea1c0df-e941-4226-90e0-a9aa08c6f364 response_code = 200 uri = /vpc-routes
28542024-11-05T00:05:42.473ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
28552024-11-05T00:05:42.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40060 req_id = 69566045-8d16-4663-8ec1-9cd745b13d9d response_code = 204 uri = /eip-gateways
28562024-11-05T00:05:42.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40060 req_id = 4eded3e0-1308-457f-8602-63fe61b06dc1 response_code = 204 uri = /vpc-routes
28572024-11-05T00:05:42.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60793
28582024-11-05T00:05:42.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60793 req_id = e3ac25b7-965c-4df1-b951-45bf8b3fbe6a response_code = 200 uri = /vpc-routes
28592024-11-05T00:05:42.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63272
28602024-11-05T00:05:42.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63272 req_id = fc730a25-85eb-4fcd-b20c-1c845131061e response_code = 200 uri = /v2p
28612024-11-05T00:05:42.601ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
28622024-11-05T00:05:42.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60793 req_id = 0dc8aef1-0532-4e94-ac33-a51f78d5cc40 response_code = 204 uri = /eip-gateways
28632024-11-05T00:05:42.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60793 req_id = 4c5875a7-f36e-4da8-afae-3963275966b7 response_code = 204 uri = /vpc-routes
28642024-11-05T00:05:42.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57245
28652024-11-05T00:05:42.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57245 req_id = fec1df81-16c2-4fda-b008-687858493e8f response_code = 200 uri = /v2p
28662024-11-05T00:05:42.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61128
28672024-11-05T00:05:42.739ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
28682024-11-05T00:05:42.781ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28692024-11-05T00:05:42.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98655 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61128 req_id = 2c22941e-ada5-4cf2-9f47-a235cc4db022 response_code = 204 uri = /switch-ports
28702024-11-05T00:05:42.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61128 req_id = 9bd195b3-aa80-44a3-9ecc-26e56fcee7bd response_code = 200 uri = /network-bootstore-config
28712024-11-05T00:05:42.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43010
28722024-11-05T00:05:42.865ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
28732024-11-05T00:05:42.907ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28742024-11-05T00:05:42.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113165 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43010 req_id = e394c6ae-efc2-4fef-b161-29cb1ff9c0ab response_code = 204 uri = /switch-ports
28752024-11-05T00:05:42.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63582
28762024-11-05T00:05:42.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51397
28772024-11-05T00:05:42.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63582 req_id = c8fc7c61-be8a-4059-aeb7-5044c1bc9c87 response_code = 200 uri = /vpc-routes
28782024-11-05T00:05:42.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51397 req_id = ea375eee-3faa-4c70-a4ff-914ebf2d01fa response_code = 200 uri = /v2p
28792024-11-05T00:05:42.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43010 req_id = 4006fd4b-79f1-4d23-a090-0ff385950f50 response_code = 200 uri = /network-bootstore-config
28802024-11-05T00:05:43.024ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
28812024-11-05T00:05:43.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63582 req_id = 36a55bdb-f4ef-429a-ada2-fab301fdef3b response_code = 204 uri = /eip-gateways
28822024-11-05T00:05:43.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63582 req_id = 4824326e-e9f5-4dae-940d-bcb04a547a6b response_code = 204 uri = /vpc-routes
28832024-11-05T00:05:43.146ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57501
28842024-11-05T00:05:43.146ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
28852024-11-05T00:05:43.192ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
28862024-11-05T00:05:43.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111327 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57501 req_id = 09eeb282-610f-4b26-b18d-6d0e014a963d response_code = 204 uri = /switch-ports
28872024-11-05T00:05:43.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57501 req_id = 0fff7135-4936-4466-9088-28891a0aeabe response_code = 200 uri = /network-bootstore-config
28882024-11-05T00:05:45.975ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57396
28892024-11-05T00:05:45.975ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57396 req_id = 22878cea-9f2f-4d02-b9f7-5ed75dce6d5b response_code = 200 uri = /baseboard
28902024-11-05T00:05:48.058ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28912024-11-05T00:05:48.059ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28922024-11-05T00:05:48.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28932024-11-05T00:05:48.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28942024-11-05T00:05:53.400ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
28952024-11-05T00:05:58.060ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28962024-11-05T00:05:58.061ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28972024-11-05T00:05:58.062ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28982024-11-05T00:05:58.066ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
28992024-11-05T00:05:59.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60875
29002024-11-05T00:05:59.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60875 req_id = e2605b60-76c5-44fc-9eb3-0763361d1e9c response_code = 200 uri = /v2p
29012024-11-05T00:05:59.841ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(15142702) }
29022024-11-05T00:05:59.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60875 req_id = 91ecf47a-53ce-46eb-9b29-bb60dcd239b5 response_code = 204 uri = /v2p
29032024-11-05T00:05:59.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50615
29042024-11-05T00:05:59.966ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 2e02a288-ac3d-4f8f-b721-40fdb59668c9, kind: Instance { id: b39559fe-2123-48a9-99eb-12895a3c669f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15142702), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2e02a288-ac3d-4f8f-b721-40fdb59668c9, kind: Instance { id: b39559fe-2123-48a9-99eb-12895a3c669f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15142702), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2e02a288-ac3d-4f8f-b721-40fdb59668c9, kind: Instance { id: b39559fe-2123-48a9-99eb-12895a3c669f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15142702), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(15142702))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2e02a288-ac3d-4f8f-b721-40fdb59668c9, kind: Instance { id: b39559fe-2123-48a9-99eb-12895a3c669f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15142702), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-328db77a1a3", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: cb8efcf1-aa75-45b9-96b3-5d05ab944ab4, read_only_parent: Some(Volume { block_size: 512, id: b0945538-4229-4fd5-ba98-900705a61768, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 24cff527-8f09-4bec-bef5-b4144c5fd819, key: Some("drJor1HT61AzuBGscl169qRl7nkk3RxcjmLPuwt5hbQ="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: cb8efcf1-aa75-45b9-96b3-5d05ab944ab4, key: Some("szMtamVhRXYsqSNuXkK/8ffYODtZa6izVYJc5VWN6lA="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19003", "[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::13]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-328db77a1a3" }] }), cloud_init_bytes: Some(..) } instance_id = b39559fe-2123-48a9-99eb-12895a3c669f metadata = InstanceMetadata { silo_id: 73cac2e6-afc3-4b45-b597-79dfc81e8ecd, project_id: ab7fcc9b-dbba-4d54-9ee5-c52185228a24 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = dae68a73-fee4-4624-be01-90976428e742 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-05T00:05:59.955904906Z }
29052024-11-05T00:05:59.966ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f migration_id = None propolis_id = dae68a73-fee4-4624-be01-90976428e742
29062024-11-05T00:05:59.966ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f migration_id = None propolis_id = dae68a73-fee4-4624-be01-90976428e742 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 2e02a288-ac3d-4f8f-b721-40fdb59668c9, kind: Instance { id: b39559fe-2123-48a9-99eb-12895a3c669f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15142702), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2e02a288-ac3d-4f8f-b721-40fdb59668c9, kind: Instance { id: b39559fe-2123-48a9-99eb-12895a3c669f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15142702), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2e02a288-ac3d-4f8f-b721-40fdb59668c9, kind: Instance { id: b39559fe-2123-48a9-99eb-12895a3c669f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15142702), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(15142702))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2e02a288-ac3d-4f8f-b721-40fdb59668c9, kind: Instance { id: b39559fe-2123-48a9-99eb-12895a3c669f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15142702), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-328db77a1a3", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: cb8efcf1-aa75-45b9-96b3-5d05ab944ab4, read_only_parent: Some(Volume { block_size: 512, id: b0945538-4229-4fd5-ba98-900705a61768, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 24cff527-8f09-4bec-bef5-b4144c5fd819, key: Some("drJor1HT61AzuBGscl169qRl7nkk3RxcjmLPuwt5hbQ="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: cb8efcf1-aa75-45b9-96b3-5d05ab944ab4, key: Some("szMtamVhRXYsqSNuXkK/8ffYODtZa6izVYJc5VWN6lA="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19003", "[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::13]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-328db77a1a3" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-05T00:05:59.955904906Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29072024-11-05T00:05:59.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 13544 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50615 req_id = 17b6d8d5-99e3-45eb-8ca0-40b27f67c2c5 response_code = 200 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742
29082024-11-05T00:06:00.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60876
29092024-11-05T00:06:00.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60876 req_id = 2b01476f-16b9-434c-8316-7478edd9ee8a response_code = 200 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742/state
29102024-11-05T00:06:00.082ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 15142702 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29112024-11-05T00:06:00.082ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
29122024-11-05T00:06:00.125ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742 file = illumos-utils/src/zone.rs:325 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
29132024-11-05T00:06:00.151ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742 file = illumos-utils/src/zone.rs:363 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
29142024-11-05T00:06:00.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52880
29152024-11-05T00:06:00.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52880 req_id = bae01ed3-223e-4351-b56f-dd5ca9afa72e response_code = 200 uri = /vpc-routes
29162024-11-05T00:06:00.181ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {2e02a288-ac3d-4f8f-b721-40fdb59668c9: {10.151.1.175: {44f5b01c-06b5-4c83-8887-1732706cbf31}, 10.151.1.176: {44f5b01c-06b5-4c83-8887-1732706cbf31}}} }
29172024-11-05T00:06:01.480ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
29182024-11-05T00:06:01.480ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742 zone file = illumos-utils/src/running_zone.rs:488 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742 zone = oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742
29192024-11-05T00:06:01.667ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742") failed: Property not found. retry in 42.359258ms file = illumos-utils/src/svc.rs:36 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742 zone = oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742
29202024-11-05T00:06:01.719ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742") failed: Property not found. retry in 53.205694ms file = illumos-utils/src/svc.rs:36 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742 zone = oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742
29212024-11-05T00:06:01.790ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742") failed: Property not found. retry in 188.821106ms file = illumos-utils/src/svc.rs:36 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742 zone = oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742
29222024-11-05T00:06:01.994ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742") failed: Property not found. retry in 581.426969ms file = illumos-utils/src/svc.rs:36 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742 zone = oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742
29232024-11-05T00:06:02.593ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742") failed: Property not found. retry in 1.151125127s file = illumos-utils/src/svc.rs:36 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742 zone = oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742
29242024-11-05T00:06:03.757ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742") failed: Property not found. retry in 1.147811323s file = illumos-utils/src/svc.rs:36 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742 zone = oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742
29252024-11-05T00:06:04.918ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742") failed: Property not found. retry in 1.390974938s file = illumos-utils/src/svc.rs:36 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742 zone = oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742
29262024-11-05T00:06:06.344ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742 file = sled-agent/src/instance.rs:1787 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
29272024-11-05T00:06:06.355ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742") failed: Property not found. retry in 35.696198ms file = illumos-utils/src/svc.rs:36 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
29282024-11-05T00:06:06.403ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742") failed: Property not found. retry in 86.070237ms file = illumos-utils/src/svc.rs:36 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
29292024-11-05T00:06:06.502ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742") failed: Property not found. retry in 125.342081ms file = illumos-utils/src/svc.rs:36 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
29302024-11-05T00:06:06.641ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742") failed: Property not found. retry in 219.407215ms file = illumos-utils/src/svc.rs:36 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
29312024-11-05T00:06:06.875ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742") failed: Property not found. retry in 964.770588ms file = illumos-utils/src/svc.rs:36 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
29322024-11-05T00:06:07.853ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
29332024-11-05T00:06:07.891ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
29342024-11-05T00:06:08.032ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
29352024-11-05T00:06:08.033ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29362024-11-05T00:06:08.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7852529 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52880 req_id = 54353aad-b238-4a08-ada8-22286a7a712d response_code = 204 uri = /eip-gateways
29372024-11-05T00:06:08.035ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-05T00:06:08.035911731Z } file = sled-agent/src/instance.rs:780 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
29382024-11-05T00:06:08.035ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-05T00:06:08.035911731Z } propolis_id = dae68a73-fee4-4624-be01-90976428e742
29392024-11-05T00:06:08.036ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-05T00:06:08.035911731Z }, migration_in: None, migration_out: None }
29402024-11-05T00:06:08.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29412024-11-05T00:06:08.064ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29422024-11-05T00:06:08.065ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29432024-11-05T00:06:08.068ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
29442024-11-05T00:06:08.079ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-05T00:06:08.079373363Z } file = sled-agent/src/instance.rs:780 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
29452024-11-05T00:06:08.079ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-05T00:06:08.079373363Z } propolis_id = dae68a73-fee4-4624-be01-90976428e742
29462024-11-05T00:06:08.079ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-05T00:06:08.079373363Z }, migration_in: None, migration_out: None }
29472024-11-05T00:06:08.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52880 req_id = bedbe6b5-5c33-47b6-95ea-d1bf161a7da2 response_code = 204 uri = /vpc-routes
29482024-11-05T00:06:12.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56245
29492024-11-05T00:06:12.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56245 req_id = 793f90b7-8a2a-4a2e-9cbd-fdf48ba382ad response_code = 200 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742/state
29502024-11-05T00:06:12.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63633
29512024-11-05T00:06:12.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63633 req_id = 1d03e063-f396-4b9b-b840-16697fefa5d3 response_code = 200 uri = /vpc-routes
29522024-11-05T00:06:12.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35290
29532024-11-05T00:06:12.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35290 req_id = 955017e3-c352-401d-9aed-f7377f8b7c91 response_code = 200 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742/state
29542024-11-05T00:06:12.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65422
29552024-11-05T00:06:12.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65422 req_id = 269825cf-6255-4c78-8a27-bdec18aa137e response_code = 200 uri = /vpc-routes
29562024-11-05T00:06:12.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36703
29572024-11-05T00:06:12.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36703 req_id = 5312ef02-c6bb-4de5-8500-9861cfa1b9e8 response_code = 200 uri = /v2p
29582024-11-05T00:06:12.564ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {2e02a288-ac3d-4f8f-b721-40fdb59668c9: {10.151.1.176: {44f5b01c-06b5-4c83-8887-1732706cbf31}, 10.151.1.175: {44f5b01c-06b5-4c83-8887-1732706cbf31}}} }
29592024-11-05T00:06:12.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63633 req_id = 1ccc5625-f7ed-4c17-9a8e-2cf6b1f7c3e5 response_code = 204 uri = /eip-gateways
29602024-11-05T00:06:12.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63633 req_id = af41aaf6-2462-4c9b-93da-f38acff6ba52 response_code = 204 uri = /vpc-routes
29612024-11-05T00:06:12.610ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {2e02a288-ac3d-4f8f-b721-40fdb59668c9: {10.151.1.175: {44f5b01c-06b5-4c83-8887-1732706cbf31}, 10.151.1.176: {44f5b01c-06b5-4c83-8887-1732706cbf31}}} }
29622024-11-05T00:06:12.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65422 req_id = d130d0e3-cc61-4c06-9a98-4454d28a8521 response_code = 204 uri = /eip-gateways
29632024-11-05T00:06:12.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55031
29642024-11-05T00:06:12.628ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
29652024-11-05T00:06:12.678ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
29662024-11-05T00:06:12.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115937 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55031 req_id = f82da765-8592-4ba3-9fb5-ba73e0ab0aed response_code = 204 uri = /switch-ports
29672024-11-05T00:06:12.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36753
29682024-11-05T00:06:12.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59609
29692024-11-05T00:06:12.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62670
29702024-11-05T00:06:12.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55031 req_id = fcfb257d-e36b-4488-8601-51c3e633de23 response_code = 200 uri = /network-bootstore-config
29712024-11-05T00:06:12.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54360
29722024-11-05T00:06:12.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59609 req_id = fbc7cd1f-ab96-4f7e-a1c1-6b568730740c response_code = 200 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742/state
29732024-11-05T00:06:12.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 532 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65422 req_id = f6bc79b6-8c77-4a88-a3de-6a05ea9b8b09 response_code = 204 uri = /vpc-routes
29742024-11-05T00:06:12.745ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
29752024-11-05T00:06:12.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54360 req_id = b4ee5ebf-d862-41cb-ab4f-1938b2a9cf0a response_code = 200 uri = /vpc-routes
29762024-11-05T00:06:12.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 376 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62670 req_id = e9dc9860-3b76-4a93-add4-9bfe6afba7de response_code = 200 uri = /v2p
29772024-11-05T00:06:12.793ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {2e02a288-ac3d-4f8f-b721-40fdb59668c9: {10.151.1.176: {44f5b01c-06b5-4c83-8887-1732706cbf31}, 10.151.1.175: {44f5b01c-06b5-4c83-8887-1732706cbf31}}} }
29782024-11-05T00:06:12.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54360 req_id = 85163e4b-4218-4ea1-896d-1b92914c7102 response_code = 204 uri = /eip-gateways
29792024-11-05T00:06:12.801ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
29802024-11-05T00:06:12.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59744
29812024-11-05T00:06:12.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59744 req_id = c0e40ba8-4c94-444b-856e-eb3f08d55019 response_code = 200 uri = /v2p
29822024-11-05T00:06:12.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 413 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54360 req_id = 7e038a5e-1b6c-4aa7-b47f-2672b98e6d6d response_code = 204 uri = /vpc-routes
29832024-11-05T00:06:12.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43186
29842024-11-05T00:06:12.880ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
29852024-11-05T00:06:12.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134682 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36753 req_id = b4e1d7ac-4f13-4960-90ad-388ffec613b2 response_code = 204 uri = /switch-ports
29862024-11-05T00:06:12.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 748 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36753 req_id = 488ba478-4c54-44bd-97da-751ab62162b0 response_code = 200 uri = /network-bootstore-config
29872024-11-05T00:06:12.921ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
29882024-11-05T00:06:12.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151840 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43186 req_id = b0bc396a-f581-42e2-8d7f-dae6c493f1a5 response_code = 204 uri = /switch-ports
29892024-11-05T00:06:12.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43186 req_id = 44d3ddef-723f-4c61-a0a3-eeb4e9ad89b4 response_code = 200 uri = /network-bootstore-config
29902024-11-05T00:06:16.009ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34133
29912024-11-05T00:06:16.009ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34133 req_id = e0ff9e65-492e-4a50-8755-5c1ecb7c0f68 response_code = 200 uri = /baseboard
29922024-11-05T00:06:17.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36086
29932024-11-05T00:06:17.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 643 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36086 req_id = 3f2fc544-f971-4ec1-bf04-a2805334c531 response_code = 200 uri = /vmms/dae68a73-fee4-4624-be01-90976428e742/state
29942024-11-05T00:06:17.749ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-05T00:06:17.749877767Z } file = sled-agent/src/instance.rs:780 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
29952024-11-05T00:06:17.749ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-05T00:06:17.749877767Z } propolis_id = dae68a73-fee4-4624-be01-90976428e742
29962024-11-05T00:06:17.749ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-05T00:06:17.749877767Z }, migration_in: None, migration_out: None }
29972024-11-05T00:06:17.810ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-05T00:06:17.810897940Z } file = sled-agent/src/instance.rs:780 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
29982024-11-05T00:06:17.810ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-05T00:06:17.810897940Z } propolis_id = dae68a73-fee4-4624-be01-90976428e742
29992024-11-05T00:06:17.810ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
30002024-11-05T00:06:17.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
30012024-11-05T00:06:17.811ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
30022024-11-05T00:06:17.811ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/6e4a40d2-b3cd-4961-8098-a9d57834f0b0/debug/bundle/zone", "/pool/int/fde07b41-a029-4be1-85a1-4d19a7248f1f/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/a7cbccab-0e4b-441b-8c32-0d4fd283b1f2/crypt/debug", "/pool/ext/b5c4456c-1550-488e-a3c6-7a939b550b2b/crypt/debug", "/pool/ext/8c7bfacc-ee49-4b61-8144-c219a6f7eec1/crypt/debug", "/pool/ext/3f4115a5-5de9-472a-ac27-660d79d3d1f7/crypt/debug", "/pool/ext/6634f6ec-a171-4828-a984-8fb31f78439b/crypt/debug", "/pool/ext/aeae1e8c-da96-4cb8-a754-49b610133fd0/crypt/debug", "/pool/ext/ffa9fae5-11fd-49c9-ab91-90383e170a6c/crypt/debug", "/pool/ext/7bc77ba6-9886-4954-bc34-bc232ce1413f/crypt/debug", "/pool/ext/7449cf8d-6d8a-4759-b257-0067c28bc087/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742
30032024-11-05T00:06:18.069ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30042024-11-05T00:06:18.070ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30052024-11-05T00:06:18.071ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30062024-11-05T00:06:18.075ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30072024-11-05T00:06:18.480ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742", bundle_id: 16aac22d-4981-43d9-b96c-da4767e0e73c }, time_created: 2024-11-05T00:06:17.812236448Z, version: 0, cause: TerminatedInstance }
30082024-11-05T00:06:18.480ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_dae68a73-fee4-4624-be01-90976428e742 file = sled-agent/src/instance.rs:1032 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
30092024-11-05T00:06:20.328ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
30102024-11-05T00:06:20.348ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(15142702), kind: System }
30112024-11-05T00:06:20.348ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(15142702), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30122024-11-05T00:06:20.349ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-05T00:06:20.349241897Z }, migration_in: None, migration_out: None }
30132024-11-05T00:06:20.444ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-05T00:06:20.349241897Z }, migration_in: None, migration_out: None }
30142024-11-05T00:06:20.447ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = b39559fe-2123-48a9-99eb-12895a3c669f propolis_id = dae68a73-fee4-4624-be01-90976428e742
30152024-11-05T00:06:21.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56619
30162024-11-05T00:06:21.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56619 req_id = 63a2fa69-aea9-4b03-9b80-bf1b71393ff5 response_code = 200 uri = /vpc-routes
30172024-11-05T00:06:21.076ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
30182024-11-05T00:06:21.077ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1233 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29
30192024-11-05T00:06:21.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56619 req_id = 7f598c18-9c70-42ca-9244-c35775abbed1 response_code = 204 uri = /eip-gateways
30202024-11-05T00:06:21.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41675
30212024-11-05T00:06:21.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41675 req_id = f73aa0ff-9fe0-4552-8703-c27e201714c3 response_code = 200 uri = /v2p
30222024-11-05T00:06:21.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56619 req_id = 1ab16fe3-c293-4165-9861-9c842d9e8ec7 response_code = 204 uri = /vpc-routes
30232024-11-05T00:06:22.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55630
30242024-11-05T00:06:22.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55630 req_id = 531f2972-050c-4ab6-81f9-0744b0ed2c5f response_code = 200 uri = /v2p
30252024-11-05T00:06:22.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36552
30262024-11-05T00:06:22.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36552 req_id = bd92b17f-6a2e-4d31-a622-f09e55afc6d6 response_code = 200 uri = /vpc-routes
30272024-11-05T00:06:22.444ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
30282024-11-05T00:06:22.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36552 req_id = 95c20497-ccd0-4cee-9e87-0ae0192ca070 response_code = 204 uri = /eip-gateways
30292024-11-05T00:06:22.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36552 req_id = 0b745fbc-7937-4b5b-9aa1-c337cfa5d194 response_code = 204 uri = /vpc-routes
30302024-11-05T00:06:23.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40091
30312024-11-05T00:06:23.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40091 req_id = a1460cc8-184b-4f77-8a25-18e38bf34835 response_code = 200 uri = /vpc-routes
30322024-11-05T00:06:23.145ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1207 sled_id = e6b7f0bb-2ed5-4c4d-a045-f7fa17ac3a29 values = ExternalIpGatewayMap { mappings: {} }
30332024-11-05T00:06:23.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40091 req_id = 1bba34c1-bfd3-4ee0-8c2b-3e3947ab7b28 response_code = 204 uri = /eip-gateways
30342024-11-05T00:06:23.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40091 req_id = e1fab2ad-d693-450a-83d7-c25ad07c1a11 response_code = 204 uri = /vpc-routes