Max level shown:
1 [ Nov 22 03:51:16 Enabled. ]
2 [ Nov 22 03:51:16 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 22 03:51:16 Method "start" exited with status 0. ]
4 [ Nov 22 03:51:16 Rereading configuration. ]
5 [ Nov 22 03:51:16 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-22T03:51:16.424ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-22T03:51:16.424ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-22T03:51:16.477ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-22T03:51:16.477ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-22T03:51:16.592ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-22T03:51:16.600ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-22T03:51:16.609ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-22T03:51:17.210ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-11-22T03:51:17.351ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-22T03:51:17.351ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-22T03:51:17.351ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-22T03:51:17.351ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-22T03:51:17.351ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-22T03:51:17.351ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-22T03:51:17.353ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-22T03:51:17.353ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-22T03:51:17.353ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-22T03:51:17.353ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-22T03:51:17.353ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-22T03:51:17.354ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-22T03:51:17.354ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-22T03:51:17.354ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-22T03:51:17.354ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-22T03:51:17.366ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-22T03:51:17.366ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 648422bd-ca86-416f-b3b1-9ff65fbad8bb (zpool)
322024-11-22T03:51:17.467ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 648422bd-ca86-416f-b3b1-9ff65fbad8bb (zpool), kind: Internal }
332024-11-22T03:51:17.944ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-22T03:51:17.944ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-22T03:51:17.944ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-22T03:51:17.944ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-22T03:51:17.944ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-22T03:51:17.944ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-22T03:51:17.944ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-22T03:51:17.953ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-22T03:51:17.953ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 8681a912-5859-447f-b29e-3905ed40bd28 (zpool)
422024-11-22T03:51:18.042ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8681a912-5859-447f-b29e-3905ed40bd28 (zpool), kind: Internal }
432024-11-22T03:51:18.519ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-22T03:51:18.519ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 648422bd-ca86-416f-b3b1-9ff65fbad8bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8681a912-5859-447f-b29e-3905ed40bd28 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-22T03:51:18.519ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
462024-11-22T03:51:18.519ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
472024-11-22T03:51:18.519ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
482024-11-22T03:51:18.519ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
492024-11-22T03:51:18.519ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-22T03:51:18.519ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
512024-11-22T03:51:18.519ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
522024-11-22T03:51:18.519ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 648422bd-ca86-416f-b3b1-9ff65fbad8bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8681a912-5859-447f-b29e-3905ed40bd28 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
532024-11-22T03:51:18.519ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542024-11-22T03:51:18.519ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-11-22T03:51:18.519ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-22T03:51:18.519ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572024-11-22T03:51:18.519ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 648422bd-ca86-416f-b3b1-9ff65fbad8bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8681a912-5859-447f-b29e-3905ed40bd28 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-11-22T03:51:18.519ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592024-11-22T03:51:18.519ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
602024-11-22T03:51:18.519ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-11-22T03:51:18.519ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-22T03:51:18.519ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 648422bd-ca86-416f-b3b1-9ff65fbad8bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8681a912-5859-447f-b29e-3905ed40bd28 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-11-22T03:51:18.519ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
642024-11-22T03:51:18.519ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
652024-11-22T03:51:18.519ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
662024-11-22T03:51:18.519ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-11-22T03:51:18.519ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-22T03:51:18.519ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 648422bd-ca86-416f-b3b1-9ff65fbad8bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8681a912-5859-447f-b29e-3905ed40bd28 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-22T03:51:18.519ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-22T03:51:18.519ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-22T03:51:18.519ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-11-22T03:51:18.519ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-22T03:51:18.519ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-22T03:51:18.519ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 648422bd-ca86-416f-b3b1-9ff65fbad8bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8681a912-5859-447f-b29e-3905ed40bd28 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-22T03:51:18.519ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-22T03:51:18.519ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
772024-11-22T03:51:18.519ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
782024-11-22T03:51:18.519ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-22T03:51:18.520ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-22T03:51:18.520ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-11-22T03:51:18.520ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 648422bd-ca86-416f-b3b1-9ff65fbad8bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8681a912-5859-447f-b29e-3905ed40bd28 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
822024-11-22T03:51:18.520ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
832024-11-22T03:51:18.520ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
842024-11-22T03:51:18.520ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852024-11-22T03:51:18.520ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-22T03:51:18.520ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-11-22T03:51:18.520ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-11-22T03:51:18.520ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 648422bd-ca86-416f-b3b1-9ff65fbad8bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8681a912-5859-447f-b29e-3905ed40bd28 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-11-22T03:51:18.520ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-11-22T03:51:18.520ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-11-22T03:51:18.520ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-11-22T03:51:18.520ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-11-22T03:51:18.520ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-11-22T03:51:18.520ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 648422bd-ca86-416f-b3b1-9ff65fbad8bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8681a912-5859-447f-b29e-3905ed40bd28 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-11-22T03:51:18.520ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-11-22T03:51:18.520ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-11-22T03:51:18.520ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-22T03:51:18.520ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-22T03:51:18.520ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 648422bd-ca86-416f-b3b1-9ff65fbad8bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8681a912-5859-447f-b29e-3905ed40bd28 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-11-22T03:51:18.522ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-11-22T03:51:18.522ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-11-22T03:51:18.522ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-11-22T03:51:18.522ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-22T03:51:18.522ZINFOSledAgent (bootstore): No ledger in /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:189 peer_id = pc-sock-i86pc
1052024-11-22T03:51:18.522ZINFOSledAgent (bootstore): No ledger in /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:189 peer_id = pc-sock-i86pc
1062024-11-22T03:51:18.522ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-11-22T03:51:18.522ZINFOSledAgent (bootstore): No ledger in /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/cluster/bootstore-network-config.json file = common/src/ledger.rs:189 peer_id = pc-sock-i86pc
1082024-11-22T03:51:18.522ZINFOSledAgent (bootstore): No ledger in /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/cluster/bootstore-network-config.json file = common/src/ledger.rs:189 peer_id = pc-sock-i86pc
1092024-11-22T03:51:18.522ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-11-22T03:51:18.522ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-22T03:51:18.522ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-22T03:51:18.530ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:743
1132024-11-22T03:51:18.530ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1307, tv_nsec: 660776556 } time_to_next_cleanup = 599.999949569s
1142024-11-22T03:51:18.530ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4005
1152024-11-22T03:51:18.530ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-22T03:51:18.533ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/sled-agent-request.json file = common/src/ledger.rs:189
1172024-11-22T03:51:18.533ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/sled-agent-request.json file = common/src/ledger.rs:189
1182024-11-22T03:51:18.533ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-11-22T03:51:18.535ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-11-22T03:51:18.536ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1200
1212024-11-22T03:51:18.536ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-22T03:51:18.536ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-22T03:51:18.536ZINFOSledAgent (RSS): No ledger in /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/rss-plan-completed.marker file = common/src/ledger.rs:189
1242024-11-22T03:51:18.536ZINFOSledAgent (RSS): No ledger in /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/rss-plan-completed.marker file = common/src/ledger.rs:189
1252024-11-22T03:51:18.536ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1263
1262024-11-22T03:51:18.536ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-22T03:51:18.536ZINFOSledAgent (RSS): No ledger in /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/rss-sled-plan.json file = common/src/ledger.rs:189
1282024-11-22T03:51:18.536ZINFOSledAgent (RSS): No ledger in /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/rss-sled-plan.json file = common/src/ledger.rs:189
1292024-11-22T03:51:18.536ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1305
1302024-11-22T03:51:18.536ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-22T03:51:18.536ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-22T03:51:18.536ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-22T03:51:18.536ZINFOSledAgent (RSS): Writing ledger to /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:200
1342024-11-22T03:51:18.536ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/rss-sled-plan.json"
1352024-11-22T03:51:18.536ZINFOSledAgent (RSS): Writing ledger to /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:200
1362024-11-22T03:51:18.536ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/rss-sled-plan.json"
1372024-11-22T03:51:18.536ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, sleds: { [fdb0:18c0:4d0d:a02a::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: fcd04c0f-1471-4403-b8d9-fe281f829465 (sled), rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1382024-11-22T03:51:18.536ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1339
1392024-11-22T03:51:18.536ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1402024-11-22T03:51:18.536ZINFOSledAgent (bootstore): Writing ledger to /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-sock-i86pc
1412024-11-22T03:51:18.537ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/cluster/bootstore-network-config.json" peer_id = pc-sock-i86pc
1422024-11-22T03:51:18.537ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-sock-i86pc
1432024-11-22T03:51:18.537ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/8681a912-5859-447f-b29e-3905ed40bd28/cluster/bootstore-network-config.json" peer_id = pc-sock-i86pc
1442024-11-22T03:51:18.537ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1452024-11-22T03:51:18.537ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: fcd04c0f-1471-4403-b8d9-fe281f829465 (sled), rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1462024-11-22T03:51:18.537ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4302
1472024-11-22T03:51:18.537ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4702
1482024-11-22T03:51:18.542ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1492024-11-22T03:51:18.548ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1502024-11-22T03:51:18.548ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1512024-11-22T03:51:18.552ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1522024-11-22T03:51:18.552ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1532024-11-22T03:51:18.552ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:56481
1542024-11-22T03:51:18.553ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: fcd04c0f-1471-4403-b8d9-fe281f829465 (sled), rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1552024-11-22T03:51:18.553ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1562024-11-22T03:51:18.553ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1572024-11-22T03:51:18.553ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1582024-11-22T03:51:18.553ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1592024-11-22T03:51:18.553ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1602024-11-22T03:51:18.553ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1612024-11-22T03:51:18.553ZINFOSledAgent (StorageManager): No ledger in /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = load_disks_ledger
1622024-11-22T03:51:18.553ZINFOSledAgent (StorageManager): No ledger in /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = load_disks_ledger
1632024-11-22T03:51:18.553ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1642024-11-22T03:51:18.553ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1652024-11-22T03:51:18.553ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1662024-11-22T03:51:18.553ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1672024-11-22T03:51:18.553ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1682024-11-22T03:51:18.569ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-22T03:51:18.589ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1702024-11-22T03:51:18.607ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1712024-11-22T03:51:18.615ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:414 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
1722024-11-22T03:51:18.615ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1732024-11-22T03:51:18.615ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:426 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
1742024-11-22T03:51:18.615ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1752024-11-22T03:51:18.618ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 53.039239ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "455f06ca-2e18-43b7-9a9c-1554238d87d3", "content-length": "124", "date": "Fri, 22 Nov 2024 03:51:18 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "455f06ca-2e18-43b7-9a9c-1554238d87d3" } file = clients/ddm-admin-client/src/lib.rs:177
1762024-11-22T03:51:18.628ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_648422bd-ca86-416f-b3b1-9ff65fbad8bb/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1772024-11-22T03:51:18.651ZINFOSledAgent: successfully created encrypted zvol: name="oxi_648422bd-ca86-416f-b3b1-9ff65fbad8bb/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1782024-11-22T03:51:18.652ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_648422bd-ca86-416f-b3b1-9ff65fbad8bb/swap" file = sled-agent/src/swap_device.rs:96
1792024-11-22T03:51:18.657ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:441 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
1802024-11-22T03:51:18.657ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1812024-11-22T03:51:18.657ZINFOSledAgent (BackingFs): Ensuring dataset oxi_648422bd-ca86-416f-b3b1-9ff65fbad8bb/backing/fmd file = sled-agent/src/backing_fs.rs:138
1822024-11-22T03:51:18.671ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1832024-11-22T03:51:18.672ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 134.779733ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3ec02d4d-2e20-4f2a-b468-624f03187948", "content-length": "124", "date": "Fri, 22 Nov 2024 03:51:18 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3ec02d4d-2e20-4f2a-b468-624f03187948" } file = clients/ddm-admin-client/src/lib.rs:177
1842024-11-22T03:51:18.744ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1852024-11-22T03:51:18.807ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862024-11-22T03:51:18.808ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 107.145781ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f6f779e6-5ce9-4836-8ba1-92e50241eb37", "content-length": "124", "date": "Fri, 22 Nov 2024 03:51:18 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f6f779e6-5ce9-4836-8ba1-92e50241eb37" } file = clients/ddm-admin-client/src/lib.rs:177
1872024-11-22T03:51:18.917ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1882024-11-22T03:51:18.917ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 221.297291ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "67f334a9-c481-417b-a46e-b833ce02309a", "content-length": "124", "date": "Fri, 22 Nov 2024 03:51:18 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "67f334a9-c481-417b-a46e-b833ce02309a" } file = clients/ddm-admin-client/src/lib.rs:177
1892024-11-22T03:51:18.963ZINFOSledAgent (BackingFs): Mounting oxi_648422bd-ca86-416f-b3b1-9ff65fbad8bb/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1902024-11-22T03:51:18.976ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1912024-11-22T03:51:18.976ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1922024-11-22T03:51:18.976ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1932024-11-22T03:51:18.976ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1942024-11-22T03:51:19.139ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-22T03:51:19.140ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 210.091565ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "12339b30-047f-461a-937e-ad385b3524eb", "content-length": "124", "date": "Fri, 22 Nov 2024 03:51:18 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "12339b30-047f-461a-937e-ad385b3524eb" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-22T03:51:19.351ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1972024-11-22T03:51:19.352ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 180.660562ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6416412f-a5cb-4d39-b70f-ca198400ae23", "content-length": "124", "date": "Fri, 22 Nov 2024 03:51:18 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6416412f-a5cb-4d39-b70f-ca198400ae23" } file = clients/ddm-admin-client/src/lib.rs:177
1982024-11-22T03:51:19.534ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1992024-11-22T03:51:19.534ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 365.121089ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d3fe8196-21fc-4e48-9790-99fe9795acc7", "content-length": "124", "date": "Fri, 22 Nov 2024 03:51:18 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d3fe8196-21fc-4e48-9790-99fe9795acc7" } file = clients/ddm-admin-client/src/lib.rs:177
2002024-11-22T03:51:19.716ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2012024-11-22T03:51:19.722ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:57755 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2022024-11-22T03:51:19.722ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2032024-11-22T03:51:19.722ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:57755 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = fcd04c0f-1471-4403-b8d9-fe281f829465 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2042024-11-22T03:51:19.723ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 316.954193ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2052024-11-22T03:51:19.724ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2062024-11-22T03:51:19.724ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2072024-11-22T03:51:19.724ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:927 underlay_address = fd00:1122:3344:101::1
2082024-11-22T03:51:19.724ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2092024-11-22T03:51:19.901ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2102024-11-22T03:51:20.041ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 661.177836ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2112024-11-22T03:51:20.704ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 595.813819ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2122024-11-22T03:51:21.301ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.129426642s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2132024-11-22T03:51:22.280ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2676
2142024-11-22T03:51:22.280ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2921
2152024-11-22T03:51:22.280ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2546
2162024-11-22T03:51:22.280ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2593
2172024-11-22T03:51:22.280ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3002
2182024-11-22T03:51:22.280ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3047
2192024-11-22T03:51:22.282ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2846
2202024-11-22T03:51:22.283ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2587
2212024-11-22T03:51:22.283ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='1e52a58b-bd79-4784-a77b-a2eaf00314b5'/> <propval type="astring" name="rack_id" value='cccdefe3-2bc4-4184-8dc4-7e505090a7b9'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:feab:85f8'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='cccdefe3-2bc4-4184-8dc4-7e505090a7b9'/> <propval type="astring" name="sled_id" value='fcd04c0f-1471-4403-b8d9-fe281f829465'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='fcd04c0f-1471-4403-b8d9-fe281f829465'/> <propval type="astring" name="rack_uuid" value='cccdefe3-2bc4-4184-8dc4-7e505090a7b9'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='fcd04c0f-1471-4403-b8d9-fe281f829465'/> <propval type="astring" name="rack_uuid" value='cccdefe3-2bc4-4184-8dc4-7e505090a7b9'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2222024-11-22T03:51:22.284ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2232024-11-22T03:51:22.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 71.430078ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-22T03:51:22.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 51.477523ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-22T03:51:22.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 189.251065ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-22T03:51:23.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 294.53914ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-22T03:51:23.432ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.903511474s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2282024-11-22T03:51:23.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 515.787662ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-22T03:51:24.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 518.391866ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2302024-11-22T03:51:25.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.301295044s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2312024-11-22T03:51:26.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 710.254603ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2322024-11-22T03:51:27.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.123888281s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2332024-11-22T03:51:27.337ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 6.546775148s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2342024-11-22T03:51:28.852ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/fcd04c0f-1471-4403-b8d9-fe281f829465) file = sled-agent/src/nexus.rs:527 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2352024-11-22T03:51:28.882ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2362024-11-22T03:51:28.883ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2372024-11-22T03:51:28.884ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2382024-11-22T03:51:28.884ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2392024-11-22T03:51:28.884ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2402024-11-22T03:51:28.884ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:200
2412024-11-22T03:51:28.884ZINFOSledAgent (SledAgentMain): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/sled-agent-request.json"
2422024-11-22T03:51:28.884ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:200
2432024-11-22T03:51:28.884ZINFOSledAgent (SledAgentMain): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/sled-agent-request.json"
2442024-11-22T03:51:28.884ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2452024-11-22T03:51:28.885ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2462024-11-22T03:51:28.885ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4005
2472024-11-22T03:51:28.885ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:56481
2482024-11-22T03:51:29.110ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2492024-11-22T03:51:29.110ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2502024-11-22T03:51:29.110ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2512024-11-22T03:51:29.110ZINFOSledAgent (RSS): No ledger in /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/rss-service-plan-v5.json file = common/src/ledger.rs:189
2522024-11-22T03:51:29.110ZINFOSledAgent (RSS): No ledger in /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/rss-service-plan-v5.json file = common/src/ledger.rs:189
2532024-11-22T03:51:29.110ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2542024-11-22T03:51:29.110ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2552024-11-22T03:51:29.110ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2562024-11-22T03:51:29.110ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2572024-11-22T03:51:29.115ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4326 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2582024-11-22T03:51:29.115ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4342
2592024-11-22T03:51:29.115ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2602024-11-22T03:51:29.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64441
2612024-11-22T03:51:29.352ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2622024-11-22T03:51:29.353ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2632024-11-22T03:51:29.353ZINFOSledAgent (ServiceManager): No ledger in /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-zones.json file = common/src/ledger.rs:189
2642024-11-22T03:51:29.353ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-zones.json file = common/src/ledger.rs:189
2652024-11-22T03:51:29.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64441 req_id = 3c9159c7-0e99-404d-b483-6e3299294087 response_code = 200 uri = /inventory
2662024-11-22T03:51:29.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47918
2672024-11-22T03:51:29.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47918 req_id = 1dc3bd80-8bc7-4a48-b651-fe5f920f5b18 response_code = 200 uri = /sled-role
2682024-11-22T03:51:29.384ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2692024-11-22T03:51:29.384ZINFOSledAgent (RSS): Writing ledger to /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:200
2702024-11-22T03:51:29.384ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/rss-service-plan-v5.json"
2712024-11-22T03:51:29.384ZINFOSledAgent (RSS): Writing ledger to /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:200
2722024-11-22T03:51:29.384ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/rss-service-plan-v5.json"
2732024-11-22T03:51:29.384ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2742024-11-22T03:51:29.416ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 52f91584-f160-415c-b93f-d6a0d7d26d9c, pool_id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 5635ec80-c218-413d-90a5-c3f8f66cfbab, pool_id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: f819eb9e-e535-4ed5-a262-eb769f08429b, pool_id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 3004381d-e81b-41e7-911b-9bd887cdd377, pool_id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 6268de84-0618-4549-b95d-481fbb99260e, pool_id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: dcdd6b68-7ef4-43c8-90f7-14648b8b7d0a, pool_id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 80bcd7c9-262f-40ff-9c60-1adcbb2c65ce, pool_id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 3ee05ac8-3f8e-4989-97ae-0f1b22f85a98, pool_id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 46ef0533-56df-4ef9-8031-b2289e2261d0, pool_id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2752024-11-22T03:51:29.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46868
2762024-11-22T03:51:29.416ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:895 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2772024-11-22T03:51:29.417ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 52f91584-f160-415c-b93f-d6a0d7d26d9c, pool_id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 5635ec80-c218-413d-90a5-c3f8f66cfbab, pool_id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: f819eb9e-e535-4ed5-a262-eb769f08429b, pool_id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 3004381d-e81b-41e7-911b-9bd887cdd377, pool_id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 6268de84-0618-4549-b95d-481fbb99260e, pool_id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: dcdd6b68-7ef4-43c8-90f7-14648b8b7d0a, pool_id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 80bcd7c9-262f-40ff-9c60-1adcbb2c65ce, pool_id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 3ee05ac8-3f8e-4989-97ae-0f1b22f85a98, pool_id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 46ef0533-56df-4ef9-8031-b2289e2261d0, pool_id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2782024-11-22T03:51:29.417ZINFOSledAgent (StorageManager): No ledger in /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = omicron_physical_disks_ensure
2792024-11-22T03:51:29.417ZINFOSledAgent (StorageManager): No ledger in /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = omicron_physical_disks_ensure
2802024-11-22T03:51:29.417ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1175 request = omicron_physical_disks_ensure
2812024-11-22T03:51:29.417ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2822024-11-22T03:51:29.417ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2832024-11-22T03:51:29.417ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2842024-11-22T03:51:29.417ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2852024-11-22T03:51:29.565ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2862024-11-22T03:51:29.565ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool)
2872024-11-22T03:51:29.799ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9228039485292536078 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2882024-11-22T03:51:29.799ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14330594990120486476 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2892024-11-22T03:51:30.026ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2902024-11-22T03:51:30.028ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fcd04c0f-1471-4403-b8d9-fe281f829465) file = sled-agent/src/probe_manager.rs:231 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
2912024-11-22T03:51:30.087ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }
2922024-11-22T03:51:30.094ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2932024-11-22T03:51:30.094ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2942024-11-22T03:51:30.094ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2952024-11-22T03:51:30.094ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2962024-11-22T03:51:30.095ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2972024-11-22T03:51:30.095ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2982024-11-22T03:51:30.095ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2992024-11-22T03:51:30.131ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3002024-11-22T03:51:30.138ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/zone file = sled-storage/src/dataset.rs:303
3012024-11-22T03:51:30.308ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0 file = sled-storage/src/dataset.rs:389
3022024-11-22T03:51:30.316ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
3032024-11-22T03:51:30.316ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
3042024-11-22T03:51:30.316ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
3052024-11-22T03:51:30.316ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3062024-11-22T03:51:30.316ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
3072024-11-22T03:51:30.326ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
3082024-11-22T03:51:30.326ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool)
3092024-11-22T03:51:30.417ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }
3102024-11-22T03:51:30.425ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3112024-11-22T03:51:30.425ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3122024-11-22T03:51:30.425ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3132024-11-22T03:51:30.425ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3142024-11-22T03:51:30.425ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3152024-11-22T03:51:30.426ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3162024-11-22T03:51:30.426ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3172024-11-22T03:51:30.461ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3182024-11-22T03:51:30.469ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/zone file = sled-storage/src/dataset.rs:303
3192024-11-22T03:51:30.641ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363 file = sled-storage/src/dataset.rs:389
3202024-11-22T03:51:30.648ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3212024-11-22T03:51:30.648ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3222024-11-22T03:51:30.648ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3232024-11-22T03:51:30.648ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3242024-11-22T03:51:30.648ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3252024-11-22T03:51:30.658ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3262024-11-22T03:51:30.658ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool)
3272024-11-22T03:51:30.746ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }
3282024-11-22T03:51:30.754ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3292024-11-22T03:51:30.754ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3302024-11-22T03:51:30.754ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3312024-11-22T03:51:30.754ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3322024-11-22T03:51:30.754ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3332024-11-22T03:51:30.754ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3342024-11-22T03:51:30.754ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3352024-11-22T03:51:30.789ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3362024-11-22T03:51:30.798ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1182b0f1-244a-4bba-979c-4840fa5a1132/crypt/zone file = sled-storage/src/dataset.rs:303
3372024-11-22T03:51:30.973ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1182b0f1-244a-4bba-979c-4840fa5a1132 file = sled-storage/src/dataset.rs:389
3382024-11-22T03:51:30.981ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3392024-11-22T03:51:30.981ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3402024-11-22T03:51:30.981ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3412024-11-22T03:51:30.981ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3422024-11-22T03:51:30.981ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3432024-11-22T03:51:30.991ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3442024-11-22T03:51:30.991ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool)
3452024-11-22T03:51:31.090ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }
3462024-11-22T03:51:31.098ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3472024-11-22T03:51:31.098ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3482024-11-22T03:51:31.098ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3492024-11-22T03:51:31.098ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3502024-11-22T03:51:31.098ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3512024-11-22T03:51:31.098ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3522024-11-22T03:51:31.098ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3532024-11-22T03:51:31.102ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fcd04c0f-1471-4403-b8d9-fe281f829465) file = sled-agent/src/probe_manager.rs:231 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
3542024-11-22T03:51:31.134ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3552024-11-22T03:51:31.142ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f/crypt/zone file = sled-storage/src/dataset.rs:303
3562024-11-22T03:51:31.314ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f file = sled-storage/src/dataset.rs:389
3572024-11-22T03:51:31.322ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3582024-11-22T03:51:31.322ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3592024-11-22T03:51:31.322ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3602024-11-22T03:51:31.322ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3612024-11-22T03:51:31.322ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3622024-11-22T03:51:31.332ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3632024-11-22T03:51:31.332ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool)
3642024-11-22T03:51:31.424ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }
3652024-11-22T03:51:31.431ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3662024-11-22T03:51:31.432ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3672024-11-22T03:51:31.432ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3682024-11-22T03:51:31.432ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3692024-11-22T03:51:31.432ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3702024-11-22T03:51:31.432ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3712024-11-22T03:51:31.432ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3722024-11-22T03:51:31.466ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3732024-11-22T03:51:31.474ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_157e7505-0f5f-4cc6-9939-e8c05827bf3d/crypt/zone file = sled-storage/src/dataset.rs:303
3742024-11-22T03:51:31.650ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_157e7505-0f5f-4cc6-9939-e8c05827bf3d file = sled-storage/src/dataset.rs:389
3752024-11-22T03:51:31.658ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3762024-11-22T03:51:31.658ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3772024-11-22T03:51:31.658ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3782024-11-22T03:51:31.658ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3792024-11-22T03:51:31.658ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3802024-11-22T03:51:31.668ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3812024-11-22T03:51:31.668ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool)
3822024-11-22T03:51:31.764ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External }
3832024-11-22T03:51:31.772ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3842024-11-22T03:51:31.772ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3852024-11-22T03:51:31.772ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3862024-11-22T03:51:31.772ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3872024-11-22T03:51:31.772ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3882024-11-22T03:51:31.772ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3892024-11-22T03:51:31.772ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3902024-11-22T03:51:31.808ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3912024-11-22T03:51:31.816ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f13a1c2f-8642-4111-9bab-2dc9809f2e5b/crypt/zone file = sled-storage/src/dataset.rs:303
3922024-11-22T03:51:31.982ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f13a1c2f-8642-4111-9bab-2dc9809f2e5b file = sled-storage/src/dataset.rs:389
3932024-11-22T03:51:31.990ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3942024-11-22T03:51:31.990ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3952024-11-22T03:51:31.990ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3962024-11-22T03:51:31.990ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3972024-11-22T03:51:31.990ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3982024-11-22T03:51:32.000ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3992024-11-22T03:51:32.000ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool)
4002024-11-22T03:51:32.099ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }
4012024-11-22T03:51:32.107ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
4022024-11-22T03:51:32.107ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
4032024-11-22T03:51:32.107ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
4042024-11-22T03:51:32.107ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
4052024-11-22T03:51:32.107ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4062024-11-22T03:51:32.107ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4072024-11-22T03:51:32.107ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4082024-11-22T03:51:32.111ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fcd04c0f-1471-4403-b8d9-fe281f829465) file = sled-agent/src/probe_manager.rs:231 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
4092024-11-22T03:51:32.146ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4102024-11-22T03:51:32.155ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_48b787c2-7c89-4a59-9296-d71ece8b8529/crypt/zone file = sled-storage/src/dataset.rs:303
4112024-11-22T03:51:32.327ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_48b787c2-7c89-4a59-9296-d71ece8b8529 file = sled-storage/src/dataset.rs:389
4122024-11-22T03:51:32.334ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4132024-11-22T03:51:32.334ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4142024-11-22T03:51:32.334ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4152024-11-22T03:51:32.334ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4162024-11-22T03:51:32.334ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4172024-11-22T03:51:32.344ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4182024-11-22T03:51:32.344ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e4f74c89-1963-417c-814f-cb22f8634b05 (zpool)
4192024-11-22T03:51:32.456ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }
4202024-11-22T03:51:32.464ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4212024-11-22T03:51:32.464ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4222024-11-22T03:51:32.464ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4232024-11-22T03:51:32.464ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4242024-11-22T03:51:32.464ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4252024-11-22T03:51:32.464ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4262024-11-22T03:51:32.464ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4272024-11-22T03:51:32.503ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4282024-11-22T03:51:32.512ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e4f74c89-1963-417c-814f-cb22f8634b05/crypt/zone file = sled-storage/src/dataset.rs:303
4292024-11-22T03:51:32.692ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e4f74c89-1963-417c-814f-cb22f8634b05 file = sled-storage/src/dataset.rs:389
4302024-11-22T03:51:32.700ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4312024-11-22T03:51:32.700ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4322024-11-22T03:51:32.700ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4332024-11-22T03:51:32.700ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4342024-11-22T03:51:32.700ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4352024-11-22T03:51:32.711ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4362024-11-22T03:51:32.711ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool)
4372024-11-22T03:51:32.812ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }
4382024-11-22T03:51:32.820ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4392024-11-22T03:51:32.820ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4402024-11-22T03:51:32.820ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4412024-11-22T03:51:32.820ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4422024-11-22T03:51:32.820ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4432024-11-22T03:51:32.820ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4442024-11-22T03:51:32.820ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4452024-11-22T03:51:32.855ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4462024-11-22T03:51:32.863ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_79b89e7a-03ea-4602-9f51-01fb67551168/crypt/zone file = sled-storage/src/dataset.rs:303
4472024-11-22T03:51:33.043ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_79b89e7a-03ea-4602-9f51-01fb67551168 file = sled-storage/src/dataset.rs:389
4482024-11-22T03:51:33.051ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4492024-11-22T03:51:33.051ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4502024-11-22T03:51:33.051ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:200 request = omicron_physical_disks_ensure
4512024-11-22T03:51:33.051ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 648422bd-ca86-416f-b3b1-9ff65fbad8bb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8681a912-5859-447f-b29e-3905ed40bd28 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4522024-11-22T03:51:33.051ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4532024-11-22T03:51:33.052ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4542024-11-22T03:51:33.052ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-physical-disks.json" request = omicron_physical_disks_ensure
4552024-11-22T03:51:33.052ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:200 request = omicron_physical_disks_ensure
4562024-11-22T03:51:33.052ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-physical-disks.json" request = omicron_physical_disks_ensure
4572024-11-22T03:51:33.052ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:899 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
4582024-11-22T03:51:33.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4592024-11-22T03:51:33.052ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:925 generation = Generation(1) sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
4602024-11-22T03:51:33.052ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:930 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
4612024-11-22T03:51:33.052ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:935 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
4622024-11-22T03:51:33.052ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
4632024-11-22T03:51:33.052ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:941 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
4642024-11-22T03:51:33.052ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4652024-11-22T03:51:33.052ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:946 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
4662024-11-22T03:51:33.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3635807 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:46868 req_id = 9da2f946-8181-405a-84f0-b072787351f2 response_code = 200 uri = /omicron-physical-disks
4672024-11-22T03:51:33.084ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0367ed23-f8af-483e-a6c6-c6b6441bcba5 (dataset): DatasetConfig { id: 0367ed23-f8af-483e-a6c6-c6b6441bcba5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1147c5ae-11ea-4d64-81af-66c4c27e7c43 (dataset): DatasetConfig { id: 1147c5ae-11ea-4d64-81af-66c4c27e7c43 (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1278a4dd-1b49-4353-a6bb-a8157f8c8c85 (dataset): DatasetConfig { id: 1278a4dd-1b49-4353-a6bb-a8157f8c8c85 (dataset), name: DatasetName { pool_name: ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 193d1c9a-8ec1-4d7c-aa65-ef5ae291fb2d (dataset): DatasetConfig { id: 193d1c9a-8ec1-4d7c-aa65-ef5ae291fb2d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a07a11e-2daa-47f7-9ccd-20406f0869ca (dataset): DatasetConfig { id: 1a07a11e-2daa-47f7-9ccd-20406f0869ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b3ccf7a-5dfe-48c9-a63b-b526a7f22ae5 (dataset): DatasetConfig { id: 1b3ccf7a-5dfe-48c9-a63b-b526a7f22ae5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c039630-a8f0-41a9-8fdd-5c8f1c951352 (dataset): DatasetConfig { id: 1c039630-a8f0-41a9-8fdd-5c8f1c951352 (dataset), name: DatasetName { pool_name: ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1cff76a1-a704-4dba-a9f4-dbeddc9d186a (dataset): DatasetConfig { id: 1cff76a1-a704-4dba-a9f4-dbeddc9d186a (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2b609a64-8abc-4d28-8a9e-48452e9f4f49 (dataset): DatasetConfig { id: 2b609a64-8abc-4d28-8a9e-48452e9f4f49 (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d127bfd-2b8c-4711-8c65-278f42850eeb (dataset): DatasetConfig { id: 2d127bfd-2b8c-4711-8c65-278f42850eeb (dataset), name: DatasetName { pool_name: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30a868b4-a488-4087-88f9-5e5dc656f667 (dataset): DatasetConfig { id: 30a868b4-a488-4087-88f9-5e5dc656f667 (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 335fd4db-c37e-4356-b1e4-a4fd4d7fe57d (dataset): DatasetConfig { id: 335fd4db-c37e-4356-b1e4-a4fd4d7fe57d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3fa33dab-be96-4683-99f6-ea80f9189204 (dataset): DatasetConfig { id: 3fa33dab-be96-4683-99f6-ea80f9189204 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 460ddaf9-9387-4cef-9d9c-bfdebe940de5 (dataset): DatasetConfig { id: 460ddaf9-9387-4cef-9d9c-bfdebe940de5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 52f7dda6-5273-4873-80f7-c61ec6156f4a (dataset): DatasetConfig { id: 52f7dda6-5273-4873-80f7-c61ec6156f4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 578b1ea4-348a-4d20-bc78-747e3804ed09 (dataset): DatasetConfig { id: 578b1ea4-348a-4d20-bc78-747e3804ed09 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59d013ee-39d1-4bbc-937f-58a730d70d7c (dataset): DatasetConfig { id: 59d013ee-39d1-4bbc-937f-58a730d70d7c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cb8dd72-2a28-4f26-b4b6-c6920b34bd7a (dataset): DatasetConfig { id: 5cb8dd72-2a28-4f26-b4b6-c6920b34bd7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 623fa7f4-ee35-494e-826c-e55b8af852af (dataset): DatasetConfig { id: 623fa7f4-ee35-494e-826c-e55b8af852af (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 631e43e8-a5aa-4d68-9e97-394d8e037db8 (dataset): DatasetConfig { id: 631e43e8-a5aa-4d68-9e97-394d8e037db8 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 651e0c37-6d6a-4c43-8c29-b833b4f7d44c (dataset): DatasetConfig { id: 651e0c37-6d6a-4c43-8c29-b833b4f7d44c (dataset), name: DatasetName { pool_name: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 675bbb0e-3a1f-41fb-a0c0-5953e31dbb66 (dataset): DatasetConfig { id: 675bbb0e-3a1f-41fb-a0c0-5953e31dbb66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68f50af5-44d3-487c-b89c-7c469785d521 (dataset): DatasetConfig { id: 68f50af5-44d3-487c-b89c-7c469785d521 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 737a1d23-6709-48a5-9be8-0a615e42346b (dataset): DatasetConfig { id: 737a1d23-6709-48a5-9be8-0a615e42346b (dataset), name: DatasetName { pool_name: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 741e79a6-ee93-4041-bbd9-f65f3a012f82 (dataset): DatasetConfig { id: 741e79a6-ee93-4041-bbd9-f65f3a012f82 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7491533a-eeb7-496b-81d6-f38f86829c5b (dataset): DatasetConfig { id: 7491533a-eeb7-496b-81d6-f38f86829c5b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 752aa199-f048-4c41-a715-169d9ae0421f (dataset): DatasetConfig { id: 752aa199-f048-4c41-a715-169d9ae0421f (dataset), name: DatasetName { pool_name: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 796e1dc5-add9-486f-8c77-21bc4f5c123b (dataset): DatasetConfig { id: 796e1dc5-add9-486f-8c77-21bc4f5c123b (dataset), name: DatasetName { pool_name: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ab0b0d0-4100-42b3-82b9-3dc8a65a6348 (dataset): DatasetConfig { id: 7ab0b0d0-4100-42b3-82b9-3dc8a65a6348 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80775d52-3955-4f4f-b633-cf7fb2297fb6 (dataset): DatasetConfig { id: 80775d52-3955-4f4f-b633-cf7fb2297fb6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86a75710-d862-43a7-b5f8-c8fa508b8ad6 (dataset): DatasetConfig { id: 86a75710-d862-43a7-b5f8-c8fa508b8ad6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86eaa796-cd35-4ca6-b75d-2b7b614a1dfd (dataset): DatasetConfig { id: 86eaa796-cd35-4ca6-b75d-2b7b614a1dfd (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 87245cb8-b8d3-41d8-adb1-27d4b543ae7f (dataset): DatasetConfig { id: 87245cb8-b8d3-41d8-adb1-27d4b543ae7f (dataset), name: DatasetName { pool_name: ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 88726b3b-f442-4476-945f-cfdbd4e8b597 (dataset): DatasetConfig { id: 88726b3b-f442-4476-945f-cfdbd4e8b597 (dataset), name: DatasetName { pool_name: ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ad16bd3-1209-4f04-9367-da444b220394 (dataset): DatasetConfig { id: 8ad16bd3-1209-4f04-9367-da444b220394 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f731c2e-7d33-419c-aa10-abec2ba7a591 (dataset): DatasetConfig { id: 8f731c2e-7d33-419c-aa10-abec2ba7a591 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9524742e-ae95-451a-b999-05282ed2714b (dataset): DatasetConfig { id: 9524742e-ae95-451a-b999-05282ed2714b (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98c48201-ca05-4fc5-8a54-89d08b2f647c (dataset): DatasetConfig { id: 98c48201-ca05-4fc5-8a54-89d08b2f647c (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a131a2f0-281a-459c-ae15-0992529f0a6c (dataset): DatasetConfig { id: a131a2f0-281a-459c-ae15-0992529f0a6c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1bf8b2c-c38f-4b8c-8f93-8551b2c18e4b (dataset): DatasetConfig { id: a1bf8b2c-c38f-4b8c-8f93-8551b2c18e4b (dataset), name: DatasetName { pool_name: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0dc28c8-0fad-420f-b876-8c1c70077e29 (dataset): DatasetConfig { id: b0dc28c8-0fad-420f-b876-8c1c70077e29 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2d607fd-1ab9-4000-ab33-9abeca247bb9 (dataset): DatasetConfig { id: b2d607fd-1ab9-4000-ab33-9abeca247bb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b7fbc258-aa38-4e5e-b6c7-50aedbf99bc7 (dataset): DatasetConfig { id: b7fbc258-aa38-4e5e-b6c7-50aedbf99bc7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9ce8bfa-e0b4-43b3-aa55-a02ca2141901 (dataset): DatasetConfig { id: b9ce8bfa-e0b4-43b3-aa55-a02ca2141901 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bab835b7-c2dc-4951-b567-05fa67697acd (dataset): DatasetConfig { id: bab835b7-c2dc-4951-b567-05fa67697acd (dataset), name: DatasetName { pool_name: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb31682f-6558-4308-bec2-358c2e73f0f8 (dataset): DatasetConfig { id: bb31682f-6558-4308-bec2-358c2e73f0f8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bf85b7c3-a2f5-471b-a2d7-68acfe3e4d3a (dataset): DatasetConfig { id: bf85b7c3-a2f5-471b-a2d7-68acfe3e4d3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c5447b68-4dce-4da7-b4a4-fc542523607b (dataset): DatasetConfig { id: c5447b68-4dce-4da7-b4a4-fc542523607b (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c6b52e9e-4b80-422e-bd79-b9599570d798 (dataset): DatasetConfig { id: c6b52e9e-4b80-422e-bd79-b9599570d798 (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c723ff33-2771-4e44-8e95-81ea3d97fc98 (dataset): DatasetConfig { id: c723ff33-2771-4e44-8e95-81ea3d97fc98 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ca0dbdda-c092-447d-bdeb-bc434d8bd695 (dataset): DatasetConfig { id: ca0dbdda-c092-447d-bdeb-bc434d8bd695 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, caffbea1-0a2c-4fdc-ba09-a96405315d8b (dataset): DatasetConfig { id: caffbea1-0a2c-4fdc-ba09-a96405315d8b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cfdbb3ae-05e4-43bf-b997-d117070bb19e (dataset): DatasetConfig { id: cfdbb3ae-05e4-43bf-b997-d117070bb19e (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0c4a39b-0b85-45c5-909f-1a2f95a63cb2 (dataset): DatasetConfig { id: d0c4a39b-0b85-45c5-909f-1a2f95a63cb2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d104f0ec-1f98-485d-abca-85b8845d82f8 (dataset): DatasetConfig { id: d104f0ec-1f98-485d-abca-85b8845d82f8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d26b4832-7175-4219-861a-38e1956eed40 (dataset): DatasetConfig { id: d26b4832-7175-4219-861a-38e1956eed40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, da13f105-df5a-458d-940a-32fbacb3bc29 (dataset): DatasetConfig { id: da13f105-df5a-458d-940a-32fbacb3bc29 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dae7ad60-786a-4384-8402-22bb674e9aa0 (dataset): DatasetConfig { id: dae7ad60-786a-4384-8402-22bb674e9aa0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed72b1d4-908b-470f-b3f3-9d995a4973eb (dataset): DatasetConfig { id: ed72b1d4-908b-470f-b3f3-9d995a4973eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee1cf99b-7150-4e9a-ba94-acf7522adf3f (dataset): DatasetConfig { id: ee1cf99b-7150-4e9a-ba94-acf7522adf3f (dataset), name: DatasetName { pool_name: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efe08a9a-e506-41d6-ac29-880612bd7902 (dataset): DatasetConfig { id: efe08a9a-e506-41d6-ac29-880612bd7902 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f504ecb2-0d87-4f90-8b8b-a69aa3c10cb5 (dataset): DatasetConfig { id: f504ecb2-0d87-4f90-8b8b-a69aa3c10cb5 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f54d2f1b-30ae-4a3d-8a4e-409341079a81 (dataset): DatasetConfig { id: f54d2f1b-30ae-4a3d-8a4e-409341079a81 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f93b4438-2f7a-49c2-836a-0906b84c30a7 (dataset): DatasetConfig { id: f93b4438-2f7a-49c2-836a-0906b84c30a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa56e044-0f7d-4353-9605-7d90673f15b3 (dataset): DatasetConfig { id: fa56e044-0f7d-4353-9605-7d90673f15b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fef7d42b-615a-435f-9b9e-e76092e81969 (dataset): DatasetConfig { id: fef7d42b-615a-435f-9b9e-e76092e81969 (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4682024-11-22T03:51:33.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34594
4692024-11-22T03:51:33.084ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:861 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
4702024-11-22T03:51:33.084ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0367ed23-f8af-483e-a6c6-c6b6441bcba5 (dataset): DatasetConfig { id: 0367ed23-f8af-483e-a6c6-c6b6441bcba5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1147c5ae-11ea-4d64-81af-66c4c27e7c43 (dataset): DatasetConfig { id: 1147c5ae-11ea-4d64-81af-66c4c27e7c43 (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1278a4dd-1b49-4353-a6bb-a8157f8c8c85 (dataset): DatasetConfig { id: 1278a4dd-1b49-4353-a6bb-a8157f8c8c85 (dataset), name: DatasetName { pool_name: ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 193d1c9a-8ec1-4d7c-aa65-ef5ae291fb2d (dataset): DatasetConfig { id: 193d1c9a-8ec1-4d7c-aa65-ef5ae291fb2d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a07a11e-2daa-47f7-9ccd-20406f0869ca (dataset): DatasetConfig { id: 1a07a11e-2daa-47f7-9ccd-20406f0869ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b3ccf7a-5dfe-48c9-a63b-b526a7f22ae5 (dataset): DatasetConfig { id: 1b3ccf7a-5dfe-48c9-a63b-b526a7f22ae5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c039630-a8f0-41a9-8fdd-5c8f1c951352 (dataset): DatasetConfig { id: 1c039630-a8f0-41a9-8fdd-5c8f1c951352 (dataset), name: DatasetName { pool_name: ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1cff76a1-a704-4dba-a9f4-dbeddc9d186a (dataset): DatasetConfig { id: 1cff76a1-a704-4dba-a9f4-dbeddc9d186a (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2b609a64-8abc-4d28-8a9e-48452e9f4f49 (dataset): DatasetConfig { id: 2b609a64-8abc-4d28-8a9e-48452e9f4f49 (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d127bfd-2b8c-4711-8c65-278f42850eeb (dataset): DatasetConfig { id: 2d127bfd-2b8c-4711-8c65-278f42850eeb (dataset), name: DatasetName { pool_name: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30a868b4-a488-4087-88f9-5e5dc656f667 (dataset): DatasetConfig { id: 30a868b4-a488-4087-88f9-5e5dc656f667 (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 335fd4db-c37e-4356-b1e4-a4fd4d7fe57d (dataset): DatasetConfig { id: 335fd4db-c37e-4356-b1e4-a4fd4d7fe57d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3fa33dab-be96-4683-99f6-ea80f9189204 (dataset): DatasetConfig { id: 3fa33dab-be96-4683-99f6-ea80f9189204 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 460ddaf9-9387-4cef-9d9c-bfdebe940de5 (dataset): DatasetConfig { id: 460ddaf9-9387-4cef-9d9c-bfdebe940de5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 52f7dda6-5273-4873-80f7-c61ec6156f4a (dataset): DatasetConfig { id: 52f7dda6-5273-4873-80f7-c61ec6156f4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 578b1ea4-348a-4d20-bc78-747e3804ed09 (dataset): DatasetConfig { id: 578b1ea4-348a-4d20-bc78-747e3804ed09 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59d013ee-39d1-4bbc-937f-58a730d70d7c (dataset): DatasetConfig { id: 59d013ee-39d1-4bbc-937f-58a730d70d7c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cb8dd72-2a28-4f26-b4b6-c6920b34bd7a (dataset): DatasetConfig { id: 5cb8dd72-2a28-4f26-b4b6-c6920b34bd7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 623fa7f4-ee35-494e-826c-e55b8af852af (dataset): DatasetConfig { id: 623fa7f4-ee35-494e-826c-e55b8af852af (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 631e43e8-a5aa-4d68-9e97-394d8e037db8 (dataset): DatasetConfig { id: 631e43e8-a5aa-4d68-9e97-394d8e037db8 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 651e0c37-6d6a-4c43-8c29-b833b4f7d44c (dataset): DatasetConfig { id: 651e0c37-6d6a-4c43-8c29-b833b4f7d44c (dataset), name: DatasetName { pool_name: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 675bbb0e-3a1f-41fb-a0c0-5953e31dbb66 (dataset): DatasetConfig { id: 675bbb0e-3a1f-41fb-a0c0-5953e31dbb66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68f50af5-44d3-487c-b89c-7c469785d521 (dataset): DatasetConfig { id: 68f50af5-44d3-487c-b89c-7c469785d521 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 737a1d23-6709-48a5-9be8-0a615e42346b (dataset): DatasetConfig { id: 737a1d23-6709-48a5-9be8-0a615e42346b (dataset), name: DatasetName { pool_name: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 741e79a6-ee93-4041-bbd9-f65f3a012f82 (dataset): DatasetConfig { id: 741e79a6-ee93-4041-bbd9-f65f3a012f82 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7491533a-eeb7-496b-81d6-f38f86829c5b (dataset): DatasetConfig { id: 7491533a-eeb7-496b-81d6-f38f86829c5b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 752aa199-f048-4c41-a715-169d9ae0421f (dataset): DatasetConfig { id: 752aa199-f048-4c41-a715-169d9ae0421f (dataset), name: DatasetName { pool_name: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 796e1dc5-add9-486f-8c77-21bc4f5c123b (dataset): DatasetConfig { id: 796e1dc5-add9-486f-8c77-21bc4f5c123b (dataset), name: DatasetName { pool_name: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ab0b0d0-4100-42b3-82b9-3dc8a65a6348 (dataset): DatasetConfig { id: 7ab0b0d0-4100-42b3-82b9-3dc8a65a6348 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80775d52-3955-4f4f-b633-cf7fb2297fb6 (dataset): DatasetConfig { id: 80775d52-3955-4f4f-b633-cf7fb2297fb6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86a75710-d862-43a7-b5f8-c8fa508b8ad6 (dataset): DatasetConfig { id: 86a75710-d862-43a7-b5f8-c8fa508b8ad6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86eaa796-cd35-4ca6-b75d-2b7b614a1dfd (dataset): DatasetConfig { id: 86eaa796-cd35-4ca6-b75d-2b7b614a1dfd (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 87245cb8-b8d3-41d8-adb1-27d4b543ae7f (dataset): DatasetConfig { id: 87245cb8-b8d3-41d8-adb1-27d4b543ae7f (dataset), name: DatasetName { pool_name: ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 88726b3b-f442-4476-945f-cfdbd4e8b597 (dataset): DatasetConfig { id: 88726b3b-f442-4476-945f-cfdbd4e8b597 (dataset), name: DatasetName { pool_name: ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ad16bd3-1209-4f04-9367-da444b220394 (dataset): DatasetConfig { id: 8ad16bd3-1209-4f04-9367-da444b220394 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f731c2e-7d33-419c-aa10-abec2ba7a591 (dataset): DatasetConfig { id: 8f731c2e-7d33-419c-aa10-abec2ba7a591 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9524742e-ae95-451a-b999-05282ed2714b (dataset): DatasetConfig { id: 9524742e-ae95-451a-b999-05282ed2714b (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98c48201-ca05-4fc5-8a54-89d08b2f647c (dataset): DatasetConfig { id: 98c48201-ca05-4fc5-8a54-89d08b2f647c (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a131a2f0-281a-459c-ae15-0992529f0a6c (dataset): DatasetConfig { id: a131a2f0-281a-459c-ae15-0992529f0a6c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1bf8b2c-c38f-4b8c-8f93-8551b2c18e4b (dataset): DatasetConfig { id: a1bf8b2c-c38f-4b8c-8f93-8551b2c18e4b (dataset), name: DatasetName { pool_name: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0dc28c8-0fad-420f-b876-8c1c70077e29 (dataset): DatasetConfig { id: b0dc28c8-0fad-420f-b876-8c1c70077e29 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2d607fd-1ab9-4000-ab33-9abeca247bb9 (dataset): DatasetConfig { id: b2d607fd-1ab9-4000-ab33-9abeca247bb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b7fbc258-aa38-4e5e-b6c7-50aedbf99bc7 (dataset): DatasetConfig { id: b7fbc258-aa38-4e5e-b6c7-50aedbf99bc7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9ce8bfa-e0b4-43b3-aa55-a02ca2141901 (dataset): DatasetConfig { id: b9ce8bfa-e0b4-43b3-aa55-a02ca2141901 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bab835b7-c2dc-4951-b567-05fa67697acd (dataset): DatasetConfig { id: bab835b7-c2dc-4951-b567-05fa67697acd (dataset), name: DatasetName { pool_name: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb31682f-6558-4308-bec2-358c2e73f0f8 (dataset): DatasetConfig { id: bb31682f-6558-4308-bec2-358c2e73f0f8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bf85b7c3-a2f5-471b-a2d7-68acfe3e4d3a (dataset): DatasetConfig { id: bf85b7c3-a2f5-471b-a2d7-68acfe3e4d3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c5447b68-4dce-4da7-b4a4-fc542523607b (dataset): DatasetConfig { id: c5447b68-4dce-4da7-b4a4-fc542523607b (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c6b52e9e-4b80-422e-bd79-b9599570d798 (dataset): DatasetConfig { id: c6b52e9e-4b80-422e-bd79-b9599570d798 (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c723ff33-2771-4e44-8e95-81ea3d97fc98 (dataset): DatasetConfig { id: c723ff33-2771-4e44-8e95-81ea3d97fc98 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ca0dbdda-c092-447d-bdeb-bc434d8bd695 (dataset): DatasetConfig { id: ca0dbdda-c092-447d-bdeb-bc434d8bd695 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, caffbea1-0a2c-4fdc-ba09-a96405315d8b (dataset): DatasetConfig { id: caffbea1-0a2c-4fdc-ba09-a96405315d8b (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cfdbb3ae-05e4-43bf-b997-d117070bb19e (dataset): DatasetConfig { id: cfdbb3ae-05e4-43bf-b997-d117070bb19e (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0c4a39b-0b85-45c5-909f-1a2f95a63cb2 (dataset): DatasetConfig { id: d0c4a39b-0b85-45c5-909f-1a2f95a63cb2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d104f0ec-1f98-485d-abca-85b8845d82f8 (dataset): DatasetConfig { id: d104f0ec-1f98-485d-abca-85b8845d82f8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d26b4832-7175-4219-861a-38e1956eed40 (dataset): DatasetConfig { id: d26b4832-7175-4219-861a-38e1956eed40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, da13f105-df5a-458d-940a-32fbacb3bc29 (dataset): DatasetConfig { id: da13f105-df5a-458d-940a-32fbacb3bc29 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dae7ad60-786a-4384-8402-22bb674e9aa0 (dataset): DatasetConfig { id: dae7ad60-786a-4384-8402-22bb674e9aa0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed72b1d4-908b-470f-b3f3-9d995a4973eb (dataset): DatasetConfig { id: ed72b1d4-908b-470f-b3f3-9d995a4973eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee1cf99b-7150-4e9a-ba94-acf7522adf3f (dataset): DatasetConfig { id: ee1cf99b-7150-4e9a-ba94-acf7522adf3f (dataset), name: DatasetName { pool_name: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efe08a9a-e506-41d6-ac29-880612bd7902 (dataset): DatasetConfig { id: efe08a9a-e506-41d6-ac29-880612bd7902 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f504ecb2-0d87-4f90-8b8b-a69aa3c10cb5 (dataset): DatasetConfig { id: f504ecb2-0d87-4f90-8b8b-a69aa3c10cb5 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f54d2f1b-30ae-4a3d-8a4e-409341079a81 (dataset): DatasetConfig { id: f54d2f1b-30ae-4a3d-8a4e-409341079a81 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f93b4438-2f7a-49c2-836a-0906b84c30a7 (dataset): DatasetConfig { id: f93b4438-2f7a-49c2-836a-0906b84c30a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa56e044-0f7d-4353-9605-7d90673f15b3 (dataset): DatasetConfig { id: fa56e044-0f7d-4353-9605-7d90673f15b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fef7d42b-615a-435f-9b9e-e76092e81969 (dataset): DatasetConfig { id: fef7d42b-615a-435f-9b9e-e76092e81969 (dataset), name: DatasetName { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4712024-11-22T03:51:33.084ZINFOSledAgent (StorageManager): No ledger in /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-datasets.json file = common/src/ledger.rs:189 request = datasets_ensure
4722024-11-22T03:51:33.084ZINFOSledAgent (StorageManager): No ledger in /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-datasets.json file = common/src/ledger.rs:189 request = datasets_ensure
4732024-11-22T03:51:33.084ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:906 request = datasets_ensure
4742024-11-22T03:51:33.084ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4752024-11-22T03:51:33.084ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79b89e7a-03ea-4602-9f51-01fb67551168/crypt/debug"), full_name: "oxp_79b89e7a-03ea-4602-9f51-01fb67551168/crypt/debug" } file = sled-storage/src/manager.rs:1338
4762024-11-22T03:51:33.113ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fcd04c0f-1471-4403-b8d9-fe281f829465) file = sled-agent/src/probe_manager.rs:231 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
4772024-11-22T03:51:33.156ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4782024-11-22T03:51:33.156ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/zone/oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79"), full_name: "oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/zone/oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79" } file = sled-storage/src/manager.rs:1338
4792024-11-22T03:51:33.255ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4802024-11-22T03:51:33.255ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f13a1c2f-8642-4111-9bab-2dc9809f2e5b/crypt/zone"), full_name: "oxp_f13a1c2f-8642-4111-9bab-2dc9809f2e5b/crypt/zone" } file = sled-storage/src/manager.rs:1338
4812024-11-22T03:51:33.324ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4822024-11-22T03:51:33.324ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/external_dns" } file = sled-storage/src/manager.rs:1338
4832024-11-22T03:51:33.416ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4842024-11-22T03:51:33.416ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/157e7505-0f5f-4cc6-9939-e8c05827bf3d/crypt/zone"), full_name: "oxp_157e7505-0f5f-4cc6-9939-e8c05827bf3d/crypt/zone" } file = sled-storage/src/manager.rs:1338
4852024-11-22T03:51:33.485ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4862024-11-22T03:51:33.485ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/clickhouse" } file = sled-storage/src/manager.rs:1338
4872024-11-22T03:51:33.576ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4882024-11-22T03:51:33.576ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f13a1c2f-8642-4111-9bab-2dc9809f2e5b/crypt/debug"), full_name: "oxp_f13a1c2f-8642-4111-9bab-2dc9809f2e5b/crypt/debug" } file = sled-storage/src/manager.rs:1338
4892024-11-22T03:51:33.645ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4902024-11-22T03:51:33.645ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/48b787c2-7c89-4a59-9296-d71ece8b8529/crypt/zone/oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf"), full_name: "oxp_48b787c2-7c89-4a59-9296-d71ece8b8529/crypt/zone/oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf" } file = sled-storage/src/manager.rs:1338
4912024-11-22T03:51:33.746ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4922024-11-22T03:51:33.746ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
4932024-11-22T03:51:33.838ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4942024-11-22T03:51:33.838ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79b89e7a-03ea-4602-9f51-01fb67551168/crypt/zone/oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30"), full_name: "oxp_79b89e7a-03ea-4602-9f51-01fb67551168/crypt/zone/oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30" } file = sled-storage/src/manager.rs:1338
4952024-11-22T03:51:33.885ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.890122767s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
4962024-11-22T03:51:33.938ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4972024-11-22T03:51:33.938ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/zone/oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe"), full_name: "oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/zone/oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe" } file = sled-storage/src/manager.rs:1338
4982024-11-22T03:51:34.036ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4992024-11-22T03:51:34.036ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5002024-11-22T03:51:34.116ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fcd04c0f-1471-4403-b8d9-fe281f829465) file = sled-agent/src/probe_manager.rs:231 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
5012024-11-22T03:51:34.126ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5022024-11-22T03:51:34.126ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e4f74c89-1963-417c-814f-cb22f8634b05/crypt/zone/oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f"), full_name: "oxp_e4f74c89-1963-417c-814f-cb22f8634b05/crypt/zone/oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f" } file = sled-storage/src/manager.rs:1338
5032024-11-22T03:51:34.225ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5042024-11-22T03:51:34.225ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1182b0f1-244a-4bba-979c-4840fa5a1132/crucible" } file = sled-storage/src/manager.rs:1338
5052024-11-22T03:51:34.310ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5062024-11-22T03:51:34.310ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f/crypt/zone/oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d"), full_name: "oxp_3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f/crypt/zone/oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d" } file = sled-storage/src/manager.rs:1338
5072024-11-22T03:51:34.407ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5082024-11-22T03:51:34.408ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_79b89e7a-03ea-4602-9f51-01fb67551168/crucible" } file = sled-storage/src/manager.rs:1338
5092024-11-22T03:51:34.492ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5102024-11-22T03:51:34.492ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/zone/oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b"), full_name: "oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/zone/oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b" } file = sled-storage/src/manager.rs:1338
5112024-11-22T03:51:34.589ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5122024-11-22T03:51:34.589ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/external_dns" } file = sled-storage/src/manager.rs:1338
5132024-11-22T03:51:34.676ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5142024-11-22T03:51:34.676ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5152024-11-22T03:51:34.764ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5162024-11-22T03:51:34.764ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e4f74c89-1963-417c-814f-cb22f8634b05/crypt/zone/oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a"), full_name: "oxp_e4f74c89-1963-417c-814f-cb22f8634b05/crypt/zone/oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a" } file = sled-storage/src/manager.rs:1338
5172024-11-22T03:51:34.862ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5182024-11-22T03:51:34.862ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79b89e7a-03ea-4602-9f51-01fb67551168/crypt/zone/oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9"), full_name: "oxp_79b89e7a-03ea-4602-9f51-01fb67551168/crypt/zone/oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9" } file = sled-storage/src/manager.rs:1338
5192024-11-22T03:51:34.963ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5202024-11-22T03:51:34.963ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5212024-11-22T03:51:35.052ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5222024-11-22T03:51:35.052ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1182b0f1-244a-4bba-979c-4840fa5a1132/crypt/debug"), full_name: "oxp_1182b0f1-244a-4bba-979c-4840fa5a1132/crypt/debug" } file = sled-storage/src/manager.rs:1338
5232024-11-22T03:51:35.119ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fcd04c0f-1471-4403-b8d9-fe281f829465) file = sled-agent/src/probe_manager.rs:231 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
5242024-11-22T03:51:35.119ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5252024-11-22T03:51:35.119ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/157e7505-0f5f-4cc6-9939-e8c05827bf3d/crypt/zone/oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1"), full_name: "oxp_157e7505-0f5f-4cc6-9939-e8c05827bf3d/crypt/zone/oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1" } file = sled-storage/src/manager.rs:1338
5262024-11-22T03:51:35.216ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5272024-11-22T03:51:35.216ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1182b0f1-244a-4bba-979c-4840fa5a1132/crypt/zone/oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109"), full_name: "oxp_1182b0f1-244a-4bba-979c-4840fa5a1132/crypt/zone/oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109" } file = sled-storage/src/manager.rs:1338
5282024-11-22T03:51:35.311ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5292024-11-22T03:51:35.311ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/zone/oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a"), full_name: "oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/zone/oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a" } file = sled-storage/src/manager.rs:1338
5302024-11-22T03:51:35.409ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5312024-11-22T03:51:35.409ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/157e7505-0f5f-4cc6-9939-e8c05827bf3d/crypt/debug"), full_name: "oxp_157e7505-0f5f-4cc6-9939-e8c05827bf3d/crypt/debug" } file = sled-storage/src/manager.rs:1338
5322024-11-22T03:51:35.476ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5332024-11-22T03:51:35.476ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_157e7505-0f5f-4cc6-9939-e8c05827bf3d/crucible" } file = sled-storage/src/manager.rs:1338
5342024-11-22T03:51:35.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5352024-11-22T03:51:35.563ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f/crypt/zone/oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7"), full_name: "oxp_3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f/crypt/zone/oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7" } file = sled-storage/src/manager.rs:1338
5362024-11-22T03:51:35.661ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5372024-11-22T03:51:35.661ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_157e7505-0f5f-4cc6-9939-e8c05827bf3d/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5382024-11-22T03:51:35.753ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5392024-11-22T03:51:35.753ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/157e7505-0f5f-4cc6-9939-e8c05827bf3d/crypt/zone/oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29"), full_name: "oxp_157e7505-0f5f-4cc6-9939-e8c05827bf3d/crypt/zone/oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29" } file = sled-storage/src/manager.rs:1338
5402024-11-22T03:51:35.855ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5412024-11-22T03:51:35.855ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363/crucible" } file = sled-storage/src/manager.rs:1338
5422024-11-22T03:51:35.942ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5432024-11-22T03:51:35.942ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f13a1c2f-8642-4111-9bab-2dc9809f2e5b/crypt/zone/oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d"), full_name: "oxp_f13a1c2f-8642-4111-9bab-2dc9809f2e5b/crypt/zone/oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d" } file = sled-storage/src/manager.rs:1338
5442024-11-22T03:51:36.042ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5452024-11-22T03:51:36.042ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f13a1c2f-8642-4111-9bab-2dc9809f2e5b/crucible" } file = sled-storage/src/manager.rs:1338
5462024-11-22T03:51:36.120ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fcd04c0f-1471-4403-b8d9-fe281f829465) file = sled-agent/src/probe_manager.rs:231 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
5472024-11-22T03:51:36.128ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5482024-11-22T03:51:36.128ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5492024-11-22T03:51:36.224ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5502024-11-22T03:51:36.224ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1182b0f1-244a-4bba-979c-4840fa5a1132/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5512024-11-22T03:51:36.313ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5522024-11-22T03:51:36.313ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1182b0f1-244a-4bba-979c-4840fa5a1132/crypt/zone/oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849"), full_name: "oxp_1182b0f1-244a-4bba-979c-4840fa5a1132/crypt/zone/oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849" } file = sled-storage/src/manager.rs:1338
5532024-11-22T03:51:36.409ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5542024-11-22T03:51:36.409ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/zone/oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49"), full_name: "oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/zone/oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49" } file = sled-storage/src/manager.rs:1338
5552024-11-22T03:51:36.506ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5562024-11-22T03:51:36.506ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/zone/oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c"), full_name: "oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/zone/oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c" } file = sled-storage/src/manager.rs:1338
5572024-11-22T03:51:36.606ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5582024-11-22T03:51:36.606ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79b89e7a-03ea-4602-9f51-01fb67551168/crypt/zone"), full_name: "oxp_79b89e7a-03ea-4602-9f51-01fb67551168/crypt/zone" } file = sled-storage/src/manager.rs:1338
5592024-11-22T03:51:36.672ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5602024-11-22T03:51:36.672ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crucible" } file = sled-storage/src/manager.rs:1338
5612024-11-22T03:51:36.761ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5622024-11-22T03:51:36.761ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/debug"), full_name: "oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/debug" } file = sled-storage/src/manager.rs:1338
5632024-11-22T03:51:36.829ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5642024-11-22T03:51:36.829ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/zone"), full_name: "oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/zone" } file = sled-storage/src/manager.rs:1338
5652024-11-22T03:51:36.896ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5662024-11-22T03:51:36.896ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/zone/oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417"), full_name: "oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/zone/oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417" } file = sled-storage/src/manager.rs:1338
5672024-11-22T03:51:36.995ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5682024-11-22T03:51:36.995ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e4f74c89-1963-417c-814f-cb22f8634b05/crucible" } file = sled-storage/src/manager.rs:1338
5692024-11-22T03:51:37.083ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5702024-11-22T03:51:37.083ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/48b787c2-7c89-4a59-9296-d71ece8b8529/crypt/zone/oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b"), full_name: "oxp_48b787c2-7c89-4a59-9296-d71ece8b8529/crypt/zone/oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b" } file = sled-storage/src/manager.rs:1338
5712024-11-22T03:51:37.123ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fcd04c0f-1471-4403-b8d9-fe281f829465) file = sled-agent/src/probe_manager.rs:231 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
5722024-11-22T03:51:37.179ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5732024-11-22T03:51:37.179ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/48b787c2-7c89-4a59-9296-d71ece8b8529/crypt/debug"), full_name: "oxp_48b787c2-7c89-4a59-9296-d71ece8b8529/crypt/debug" } file = sled-storage/src/manager.rs:1338
5742024-11-22T03:51:37.246ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5752024-11-22T03:51:37.246ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1182b0f1-244a-4bba-979c-4840fa5a1132/crypt/zone/oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c"), full_name: "oxp_1182b0f1-244a-4bba-979c-4840fa5a1132/crypt/zone/oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c" } file = sled-storage/src/manager.rs:1338
5762024-11-22T03:51:37.343ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5772024-11-22T03:51:37.343ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_48b787c2-7c89-4a59-9296-d71ece8b8529/crucible" } file = sled-storage/src/manager.rs:1338
5782024-11-22T03:51:37.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5792024-11-22T03:51:37.456ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e4f74c89-1963-417c-814f-cb22f8634b05/crypt/debug"), full_name: "oxp_e4f74c89-1963-417c-814f-cb22f8634b05/crypt/debug" } file = sled-storage/src/manager.rs:1338
5802024-11-22T03:51:37.528ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5812024-11-22T03:51:37.528ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f/crypt/debug"), full_name: "oxp_3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f/crypt/debug" } file = sled-storage/src/manager.rs:1338
5822024-11-22T03:51:37.598ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5832024-11-22T03:51:37.598ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f/crypt/zone/oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37"), full_name: "oxp_3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f/crypt/zone/oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37" } file = sled-storage/src/manager.rs:1338
5842024-11-22T03:51:37.697ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5852024-11-22T03:51:37.697ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/zone/oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495"), full_name: "oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/zone/oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495" } file = sled-storage/src/manager.rs:1338
5862024-11-22T03:51:37.797ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5872024-11-22T03:51:37.797ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1182b0f1-244a-4bba-979c-4840fa5a1132/crypt/zone"), full_name: "oxp_1182b0f1-244a-4bba-979c-4840fa5a1132/crypt/zone" } file = sled-storage/src/manager.rs:1338
5882024-11-22T03:51:37.865ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5892024-11-22T03:51:37.865ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/48b787c2-7c89-4a59-9296-d71ece8b8529/crypt/zone"), full_name: "oxp_48b787c2-7c89-4a59-9296-d71ece8b8529/crypt/zone" } file = sled-storage/src/manager.rs:1338
5902024-11-22T03:51:37.934ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5912024-11-22T03:51:37.934ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/debug"), full_name: "oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/debug" } file = sled-storage/src/manager.rs:1338
5922024-11-22T03:51:38.002ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5932024-11-22T03:51:38.002ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f/crypt/zone"), full_name: "oxp_3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f/crypt/zone" } file = sled-storage/src/manager.rs:1338
5942024-11-22T03:51:38.074ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5952024-11-22T03:51:38.074ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1182b0f1-244a-4bba-979c-4840fa5a1132/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5962024-11-22T03:51:38.126ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fcd04c0f-1471-4403-b8d9-fe281f829465) file = sled-agent/src/probe_manager.rs:231 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
5972024-11-22T03:51:38.165ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5982024-11-22T03:51:38.165ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/zone"), full_name: "oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/zone" } file = sled-storage/src/manager.rs:1338
5992024-11-22T03:51:38.244ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6002024-11-22T03:51:38.244ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e4f74c89-1963-417c-814f-cb22f8634b05/crypt/zone/oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e"), full_name: "oxp_e4f74c89-1963-417c-814f-cb22f8634b05/crypt/zone/oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e" } file = sled-storage/src/manager.rs:1338
6012024-11-22T03:51:38.345ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6022024-11-22T03:51:38.345ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1182b0f1-244a-4bba-979c-4840fa5a1132/crypt/zone/oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577"), full_name: "oxp_1182b0f1-244a-4bba-979c-4840fa5a1132/crypt/zone/oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577" } file = sled-storage/src/manager.rs:1338
6032024-11-22T03:51:38.447ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6042024-11-22T03:51:38.447ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e4f74c89-1963-417c-814f-cb22f8634b05/crypt/zone"), full_name: "oxp_e4f74c89-1963-417c-814f-cb22f8634b05/crypt/zone" } file = sled-storage/src/manager.rs:1338
6052024-11-22T03:51:38.514ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6062024-11-22T03:51:38.514ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/zone/oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1"), full_name: "oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/zone/oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1" } file = sled-storage/src/manager.rs:1338
6072024-11-22T03:51:38.612ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6082024-11-22T03:51:38.612ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e4f74c89-1963-417c-814f-cb22f8634b05/crypt/zone/oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255"), full_name: "oxp_e4f74c89-1963-417c-814f-cb22f8634b05/crypt/zone/oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255" } file = sled-storage/src/manager.rs:1338
6092024-11-22T03:51:38.657ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4350
6102024-11-22T03:51:38.657ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4360 gateway = fd00:1122:3344:101::1
6112024-11-22T03:51:38.663ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4374 gateway = fd00:1122:3344:101::1
6122024-11-22T03:51:38.663ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4439
6132024-11-22T03:51:38.722ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6142024-11-22T03:51:38.724ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f/crucible" } file = sled-storage/src/manager.rs:1338
6152024-11-22T03:51:38.816ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4505
6162024-11-22T03:51:38.816ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4532
6172024-11-22T03:51:38.826ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6182024-11-22T03:51:38.826ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/zone/oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a"), full_name: "oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/zone/oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a" } file = sled-storage/src/manager.rs:1338
6192024-11-22T03:51:38.854ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7130346944604980870 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
6202024-11-22T03:51:38.854ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9461343710721793006 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
6212024-11-22T03:51:38.859ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4545
6222024-11-22T03:51:38.859ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4391
6232024-11-22T03:51:38.913ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4433
6242024-11-22T03:51:38.913ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4512 rack_subnet = fd00:1122:3344::
6252024-11-22T03:51:38.935ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:200 request = datasets_ensure
6262024-11-22T03:51:38.935ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4523
6272024-11-22T03:51:38.935ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4565
6282024-11-22T03:51:38.937ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-datasets.json" request = datasets_ensure
6292024-11-22T03:51:38.937ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:200 request = datasets_ensure
6302024-11-22T03:51:38.938ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-datasets.json" request = datasets_ensure
6312024-11-22T03:51:38.938ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:863 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
6322024-11-22T03:51:38.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5854246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34594 req_id = e165e731-43db-4537-beec-f59d0bb890a9 response_code = 200 uri = /datasets
6332024-11-22T03:51:38.984ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 6f3e43a0-44c3-470b-aeed-59e4d3e6b91a (service), filesystem_pool: Some(ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0a6d4402-4330-4dac-a6fc-1163b7dedc8a (service), filesystem_pool: Some(ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d2bf14c6-9ae0-4e6c-817f-248aabab435c (service), filesystem_pool: Some(ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6342024-11-22T03:51:38.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57433
6352024-11-22T03:51:38.984ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6362024-11-22T03:51:38.984ZINFOSledAgent (ServiceManager): No ledger in /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-zones.json file = common/src/ledger.rs:189
6372024-11-22T03:51:38.984ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-zones.json file = common/src/ledger.rs:189
6382024-11-22T03:51:38.984ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
6392024-11-22T03:51:38.984ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
6402024-11-22T03:51:38.985ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
6412024-11-22T03:51:38.985ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
6422024-11-22T03:51:38.985ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6432024-11-22T03:51:39.010ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4597
6442024-11-22T03:51:39.010ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4603
6452024-11-22T03:51:39.040ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6462024-11-22T03:51:39.040ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6472024-11-22T03:51:39.040ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6482024-11-22T03:51:39.099ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a file = illumos-utils/src/zone.rs:325
6492024-11-22T03:51:39.104ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a file = illumos-utils/src/zone.rs:325
6502024-11-22T03:51:39.109ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c file = illumos-utils/src/zone.rs:325
6512024-11-22T03:51:39.112ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4644
6522024-11-22T03:51:39.112ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6532024-11-22T03:51:39.119ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a file = illumos-utils/src/zone.rs:363
6542024-11-22T03:51:39.125ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a file = illumos-utils/src/zone.rs:363
6552024-11-22T03:51:39.130ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c file = illumos-utils/src/zone.rs:363
6562024-11-22T03:51:39.134ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fcd04c0f-1471-4403-b8d9-fe281f829465) file = sled-agent/src/probe_manager.rs:231 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
6572024-11-22T03:51:39.155ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6582024-11-22T03:51:39.155ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/fcd04c0f-1471-4403-b8d9-fe281f829465) file = sled-agent/src/nexus.rs:527 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
6592024-11-22T03:51:39.194ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6602024-11-22T03:51:39.194ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6612024-11-22T03:51:39.195ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6622024-11-22T03:51:39.195ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6632024-11-22T03:51:39.252ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
6642024-11-22T03:51:39.323ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6652024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6662024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6672024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6682024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6692024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6702024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6712024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6722024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6732024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6742024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6752024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6762024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6772024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6782024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6792024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6802024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6812024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6822024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6832024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6842024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6852024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6862024-11-22T03:51:39.323ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6872024-11-22T03:51:39.802ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9228039485292536078 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
6882024-11-22T03:51:39.802ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14330594990120486476 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
6892024-11-22T03:51:40.136ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fcd04c0f-1471-4403-b8d9-fe281f829465) file = sled-agent/src/probe_manager.rs:231 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
6902024-11-22T03:51:40.689ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6912024-11-22T03:51:40.689ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6922024-11-22T03:51:40.689ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a
6932024-11-22T03:51:41.174ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6942024-11-22T03:51:41.656ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6952024-11-22T03:51:41.656ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6962024-11-22T03:51:41.656ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6972024-11-22T03:51:41.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a") failed: Property not found. retry in 74.115466ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a
6982024-11-22T03:51:41.663ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a
6992024-11-22T03:51:41.668ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c
7002024-11-22T03:51:41.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a") failed: Property not found. retry in 97.53733ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a
7012024-11-22T03:51:41.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a") failed: Property not found. retry in 39.161353ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a
7022024-11-22T03:51:41.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c") failed: Property not found. retry in 29.840601ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c
7032024-11-22T03:51:41.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c") failed: Property not found. retry in 66.466432ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c
7042024-11-22T03:51:41.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a") failed: Property not found. retry in 115.163361ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a
7052024-11-22T03:51:41.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a") failed: Property not found. retry in 157.383466ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a
7062024-11-22T03:51:42.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c") failed: Property not found. retry in 154.22706ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c
7072024-11-22T03:51:42.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a") failed: Property not found. retry in 463.146903ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a
7082024-11-22T03:51:42.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a") failed: Property not found. retry in 211.069607ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a
7092024-11-22T03:51:42.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c") failed: Property not found. retry in 232.406793ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c
7102024-11-22T03:51:42.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a") failed: Property not found. retry in 239.496394ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a
7112024-11-22T03:51:42.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c") failed: Property not found. retry in 732.844756ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c
7122024-11-22T03:51:42.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a") failed: Property not found. retry in 981.515944ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a
7132024-11-22T03:51:42.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a") failed: Property not found. retry in 1.041234115s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a
7142024-11-22T03:51:43.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c") failed: Property not found. retry in 574.236149ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c
7152024-11-22T03:51:43.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a") failed: Property not found. retry in 1.168318635s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a
7162024-11-22T03:51:43.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a") failed: Property not found. retry in 889.112294ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a
7172024-11-22T03:51:43.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c") failed: Property not found. retry in 1.232269192s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c
7182024-11-22T03:51:44.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a") failed: Property not found. retry in 1.255394805s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a
7192024-11-22T03:51:44.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a") failed: Property not found. retry in 593.217458ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a
7202024-11-22T03:51:45.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c") failed: Property not found. retry in 599.068731ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c
7212024-11-22T03:51:45.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a") failed: Property not found. retry in 789.725035ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a
7222024-11-22T03:51:45.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c") failed: Property not found. retry in 678.46592ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c
7232024-11-22T03:51:45.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a") failed: Property not found. retry in 575.910123ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a
7242024-11-22T03:51:46.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a") failed: Property not found. retry in 704.011595ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a
7252024-11-22T03:51:46.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c") failed: Property not found. retry in 1.472864323s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c
7262024-11-22T03:51:46.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a") failed: Property not found. retry in 1.157125003s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a
7272024-11-22T03:51:47.860ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_6f3e43a0-44c3-470b-aeed-59e4d3e6b91a
7282024-11-22T03:51:47.860ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_0a6d4402-4330-4dac-a6fc-1163b7dedc8a
7292024-11-22T03:51:47.860ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_d2bf14c6-9ae0-4e6c-817f-248aabab435c
7302024-11-22T03:51:47.860ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7312024-11-22T03:51:47.861ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-zones.json"
7322024-11-22T03:51:47.861ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7332024-11-22T03:51:47.861ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-zones.json"
7342024-11-22T03:51:47.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8876976 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57433 req_id = 053c3d09-e0e8-47d8-b2ca-ba2194dc6064 response_code = 204 uri = /omicron-zones
7352024-11-22T03:51:47.863ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7362024-11-22T03:51:47.917ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7372024-11-22T03:51:47.964ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7382024-11-22T03:51:48.012ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7392024-11-22T03:51:48.012ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7402024-11-22T03:51:48.045ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7412024-11-22T03:51:48.047ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7422024-11-22T03:51:48.047ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7432024-11-22T03:51:48.076ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 6f3e43a0-44c3-470b-aeed-59e4d3e6b91a (service), filesystem_pool: Some(ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0a6d4402-4330-4dac-a6fc-1163b7dedc8a (service), filesystem_pool: Some(ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d2bf14c6-9ae0-4e6c-817f-248aabab435c (service), filesystem_pool: Some(ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: e67b4a71-a906-471d-a736-bd080c0ecc30 (service), filesystem_pool: Some(ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4e0f68fb-ad2b-473d-9d7e-84f9e6c88284, kind: Service { id: e67b4a71-a906-471d-a736-bd080c0ecc30 }, name: Name("ntp-e67b4a71-a906-471d-a736-bd080c0ecc30"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 4])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7442024-11-22T03:51:48.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60788
7452024-11-22T03:51:48.077ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7462024-11-22T03:51:48.077ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-zones.json file = common/src/ledger.rs:178
7472024-11-22T03:51:48.077ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-zones.json file = common/src/ledger.rs:178
7482024-11-22T03:51:48.077ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
7492024-11-22T03:51:48.077ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
7502024-11-22T03:51:48.077ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
7512024-11-22T03:51:48.077ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
7522024-11-22T03:51:48.077ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7532024-11-22T03:51:48.090ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7542024-11-22T03:51:48.123ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7552024-11-22T03:51:48.124ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7562024-11-22T03:51:48.124ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7572024-11-22T03:51:48.153ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 147, 4]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7582024-11-22T03:51:48.153ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = boundary_ntp
7592024-11-22T03:51:48.154ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7602024-11-22T03:51:48.154ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7612024-11-22T03:51:48.154ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7622024-11-22T03:51:48.154ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7632024-11-22T03:51:48.179ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30 file = illumos-utils/src/zone.rs:325
7642024-11-22T03:51:48.198ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30 file = illumos-utils/src/zone.rs:363
7652024-11-22T03:51:48.820ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7662024-11-22T03:51:48.820ZINFOSledAgent (ServiceManager): Booting oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30
7672024-11-22T03:51:48.856ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7130346944604980870 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
7682024-11-22T03:51:48.857ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9461343710721793006 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
7692024-11-22T03:51:48.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30") failed: Property not found. retry in 26.249889ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30
7702024-11-22T03:51:48.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30") failed: Property not found. retry in 80.952057ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30
7712024-11-22T03:51:49.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30") failed: Property not found. retry in 160.684533ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30
7722024-11-22T03:51:49.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30") failed: Property not found. retry in 568.874055ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30
7732024-11-22T03:51:49.805ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9228039485292536078 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
7742024-11-22T03:51:49.805ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14330594990120486476 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
7752024-11-22T03:51:49.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30") failed: Property not found. retry in 1.095089137s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30
7762024-11-22T03:51:50.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30") failed: Property not found. retry in 1.380194941s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30
7772024-11-22T03:51:52.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30") failed: Property not found. retry in 612.038831ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30
7782024-11-22T03:51:52.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30") failed: Property not found. retry in 1.316662643s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30
7792024-11-22T03:51:54.280ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30
7802024-11-22T03:51:54.280ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7812024-11-22T03:51:54.281ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-zones.json"
7822024-11-22T03:51:54.281ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7832024-11-22T03:51:54.281ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-zones.json"
7842024-11-22T03:51:54.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6204416 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60788 req_id = b1396e99-3cbd-4861-8ee4-8ec58434f67c response_code = 204 uri = /omicron-zones
7852024-11-22T03:51:54.284ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7862024-11-22T03:51:54.314ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7872024-11-22T03:51:54.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53559
7882024-11-22T03:51:54.323ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
7892024-11-22T03:51:54.323ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9002 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53559 req_id = d3484189-cf7d-4787-bc0e-0cb4313e78df response_code = 500 uri = /timesync
7902024-11-22T03:51:54.326ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7912024-11-22T03:51:54.435ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7922024-11-22T03:51:54.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61917
7932024-11-22T03:51:56.891ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3529012499790410646 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
7942024-11-22T03:51:57.589ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15647096492614378618 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
7952024-11-22T03:51:57.863ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13889544426170480206 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
7962024-11-22T03:51:58.444ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
7972024-11-22T03:51:58.445ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009501 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61917 req_id = be852691-9012-48d6-877b-4f7518258e53 response_code = 500 uri = /timesync
7982024-11-22T03:51:58.447ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7992024-11-22T03:51:58.610ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8002024-11-22T03:51:58.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33838
8012024-11-22T03:51:58.619ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
8022024-11-22T03:51:58.619ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9018 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33838 req_id = d1af83a2-c9af-4dca-aea0-686b930a5a6e response_code = 500 uri = /timesync
8032024-11-22T03:51:58.622ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8042024-11-22T03:51:58.809ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8052024-11-22T03:51:58.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49378
8062024-11-22T03:51:58.860ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7130346944604980870 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
8072024-11-22T03:51:58.860ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9461343710721793006 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
8082024-11-22T03:51:59.808ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9228039485292536078 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
8092024-11-22T03:51:59.808ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14330594990120486476 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
8102024-11-22T03:52:02.372ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e67b4a71-a906-471d-a736-bd080c0ecc30': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
8112024-11-22T03:52:02.372ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008784 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49378 req_id = 7cf01e76-0a0d-4e71-9c16-0553a75d816a response_code = 500 uri = /timesync
8122024-11-22T03:52:02.374ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8132024-11-22T03:52:02.559ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8142024-11-22T03:52:02.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58245
8152024-11-22T03:52:02.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8431 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58245 req_id = 41d1b42a-bb2a-4056-a99e-77a89383701c response_code = 200 uri = /timesync
8162024-11-22T03:52:02.571ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732247519.5563426, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8172024-11-22T03:52:02.571ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8182024-11-22T03:52:02.764ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8192024-11-22T03:52:02.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43024
8202024-11-22T03:52:02.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8680 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43024 req_id = cc27f48e-e48f-4d1a-9a33-406ed1cd8e56 response_code = 200 uri = /timesync
8212024-11-22T03:52:02.774ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732247519.5563426, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8222024-11-22T03:52:02.774ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8232024-11-22T03:52:02.994ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8242024-11-22T03:52:02.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35571
8252024-11-22T03:52:03.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8345 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35571 req_id = 64f3b470-6a01-4c86-a3b8-192e44fc21d4 response_code = 200 uri = /timesync
8262024-11-22T03:52:03.004ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732247519.5563426, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8272024-11-22T03:52:03.004ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8282024-11-22T03:52:03.356ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 344.263851ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
8292024-11-22T03:52:03.448ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8302024-11-22T03:52:03.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53373
8312024-11-22T03:52:03.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7741 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53373 req_id = c4149420-ae3d-4024-abf6-31541a8282e2 response_code = 200 uri = /timesync
8322024-11-22T03:52:03.460ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732247519.5563426, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8332024-11-22T03:52:03.460ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8342024-11-22T03:52:03.763ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8352024-11-22T03:52:03.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39666
8362024-11-22T03:52:03.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8613 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39666 req_id = fba44650-5e1a-4bbb-92e9-94919d60c908 response_code = 200 uri = /timesync
8372024-11-22T03:52:03.774ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732247519.5563426, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8382024-11-22T03:52:03.774ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8392024-11-22T03:52:03.825ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15576343549335075668 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
8402024-11-22T03:52:03.825ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6708589135242741314 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
8412024-11-22T03:52:04.027ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8422024-11-22T03:52:04.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40715
8432024-11-22T03:52:04.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8854 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40715 req_id = 1db0b675-f192-4512-bd70-8359e0836c2c response_code = 200 uri = /timesync
8442024-11-22T03:52:04.039ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732247519.5563426, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8452024-11-22T03:52:04.039ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8462024-11-22T03:52:04.395ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8472024-11-22T03:52:04.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58709
8482024-11-22T03:52:04.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8918 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58709 req_id = 022de740-ec4f-4b9f-90a2-31ecf4e8a8d1 response_code = 200 uri = /timesync
8492024-11-22T03:52:04.408ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732247519.5563426, correction: 0.267183334 } file = sled-agent/src/rack_setup/service.rs:740
8502024-11-22T03:52:04.408ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8512024-11-22T03:52:04.962ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8522024-11-22T03:52:04.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55037
8532024-11-22T03:52:04.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55037 req_id = 97739cda-5f8c-4a91-8577-af77bec0c956 response_code = 200 uri = /timesync
8542024-11-22T03:52:04.973ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732247519.5563426, correction: 0.265653849 } file = sled-agent/src/rack_setup/service.rs:740
8552024-11-22T03:52:04.973ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8562024-11-22T03:52:05.885ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8572024-11-22T03:52:05.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59396
8582024-11-22T03:52:05.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8534 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59396 req_id = 88c53ae1-6319-4eb4-818d-c9d728504c5e response_code = 200 uri = /timesync
8592024-11-22T03:52:05.898ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732247519.5563426, correction: 0.258473933 } file = sled-agent/src/rack_setup/service.rs:740
8602024-11-22T03:52:05.898ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8612024-11-22T03:52:06.439ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3529012499790410646 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
8622024-11-22T03:52:07.084ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8632024-11-22T03:52:07.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58254
8642024-11-22T03:52:07.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8714 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58254 req_id = 72a80cb6-88ec-40f0-931a-3cac8b0c1ae8 response_code = 200 uri = /timesync
8652024-11-22T03:52:07.097ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732247519.5563426, correction: 0.235207483 } file = sled-agent/src/rack_setup/service.rs:740
8662024-11-22T03:52:07.097ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8672024-11-22T03:52:07.138ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15647096492614378618 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
8682024-11-22T03:52:07.413ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13889544426170480206 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
8692024-11-22T03:52:07.865ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8702024-11-22T03:52:07.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35807
8712024-11-22T03:52:07.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8425 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35807 req_id = 7932355f-f5c0-45ea-aa09-f09f2b2c06b5 response_code = 200 uri = /timesync
8722024-11-22T03:52:07.878ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732247519.5563426, correction: 0.233099237 } file = sled-agent/src/rack_setup/service.rs:740
8732024-11-22T03:52:07.878ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8742024-11-22T03:52:08.412ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7130346944604980870 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
8752024-11-22T03:52:08.412ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9461343710721793006 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
8762024-11-22T03:52:08.472ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65426
8772024-11-22T03:52:08.472ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65426 req_id = c3b39a13-5bd0-43f4-a9f1-8fdc7ada47fe response_code = 200 uri = /baseboard
8782024-11-22T03:52:08.836ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8792024-11-22T03:52:08.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63492
8802024-11-22T03:52:08.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8681 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63492 req_id = b8f843ed-2618-4f50-9867-4a8d476526f2 response_code = 200 uri = /timesync
8812024-11-22T03:52:08.847ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732247519.5563426, correction: 0.226823777 } file = sled-agent/src/rack_setup/service.rs:740
8822024-11-22T03:52:08.847ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8832024-11-22T03:52:09.364ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9228039485292536078 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
8842024-11-22T03:52:09.364ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14330594990120486476 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
8852024-11-22T03:52:10.048ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8862024-11-22T03:52:10.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39738
8872024-11-22T03:52:10.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39738 req_id = 6209d15b-bccc-4227-892b-c18dc940c1b2 response_code = 200 uri = /timesync
8882024-11-22T03:52:10.060ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1732247529.2564387, correction: 0.223391131 } file = sled-agent/src/rack_setup/service.rs:740
8892024-11-22T03:52:10.060ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8902024-11-22T03:52:11.213ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8912024-11-22T03:52:11.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60070
8922024-11-22T03:52:11.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8595 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60070 req_id = bd0ad3f6-0a5c-42c4-a417-74aede338d5f response_code = 200 uri = /timesync
8932024-11-22T03:52:11.226ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1732247529.9288917, correction: 0.219736576 } file = sled-agent/src/rack_setup/service.rs:740
8942024-11-22T03:52:11.226ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8952024-11-22T03:52:13.103ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8962024-11-22T03:52:13.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61292
8972024-11-22T03:52:13.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9443 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61292 req_id = 4dbc057f-1e57-4b94-bf40-3f7a2f7cc4a3 response_code = 200 uri = /timesync
8982024-11-22T03:52:13.117ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1732247532.4189167, correction: 0.214447916 } file = sled-agent/src/rack_setup/service.rs:740
8992024-11-22T03:52:13.117ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9002024-11-22T03:52:13.850ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15576343549335075668 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9012024-11-22T03:52:13.850ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6708589135242741314 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9022024-11-22T03:52:15.660ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9032024-11-22T03:52:15.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45909
9042024-11-22T03:52:15.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8938 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45909 req_id = 30830288-883c-46b7-8651-332c684bd77c response_code = 200 uri = /timesync
9052024-11-22T03:52:15.672ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1732247535.29398, correction: 0.207511008 } file = sled-agent/src/rack_setup/service.rs:740
9062024-11-22T03:52:15.672ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9072024-11-22T03:52:16.467ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3529012499790410646 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9082024-11-22T03:52:17.166ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15647096492614378618 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9092024-11-22T03:52:17.442ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13889544426170480206 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9102024-11-22T03:52:18.440ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7130346944604980870 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9112024-11-22T03:52:18.441ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9461343710721793006 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9122024-11-22T03:52:18.771ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 303.076242ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9132024-11-22T03:52:19.062ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9142024-11-22T03:52:19.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60163
9152024-11-22T03:52:19.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60163 req_id = 4022a075-cc75-4e80-86b6-298493e5c61d response_code = 200 uri = /timesync
9162024-11-22T03:52:19.074ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1732247538.2056346, correction: 0.198118046 } file = sled-agent/src/rack_setup/service.rs:740
9172024-11-22T03:52:19.074ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9182024-11-22T03:52:19.394ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9228039485292536078 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9192024-11-22T03:52:19.394ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14330594990120486476 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9202024-11-22T03:52:21.094ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9212024-11-22T03:52:21.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33964
9222024-11-22T03:52:21.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8675 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33964 req_id = 876bc788-162f-48ac-bffa-697a7c65ff7b response_code = 200 uri = /timesync
9232024-11-22T03:52:21.106ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1732247539.8107922, correction: 0.192538649 } file = sled-agent/src/rack_setup/service.rs:740
9242024-11-22T03:52:21.106ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9252024-11-22T03:52:23.880ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15576343549335075668 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9262024-11-22T03:52:23.880ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6708589135242741314 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9272024-11-22T03:52:26.495ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3529012499790410646 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9282024-11-22T03:52:27.194ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15647096492614378618 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9292024-11-22T03:52:27.466ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9302024-11-22T03:52:27.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52251
9312024-11-22T03:52:27.472ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13889544426170480206 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9322024-11-22T03:52:27.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8764 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52251 req_id = 5638a88f-2d96-467e-8998-3db8dddc170b response_code = 200 uri = /timesync
9332024-11-22T03:52:27.477ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1732247546.795607, correction: 0.175528958 } file = sled-agent/src/rack_setup/service.rs:740
9342024-11-22T03:52:27.477ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9352024-11-22T03:52:28.470ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7130346944604980870 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9362024-11-22T03:52:28.470ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9461343710721793006 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9372024-11-22T03:52:29.422ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9228039485292536078 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9382024-11-22T03:52:29.422ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14330594990120486476 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9392024-11-22T03:52:31.620ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9402024-11-22T03:52:31.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55617
9412024-11-22T03:52:31.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55617 req_id = ce5c85c6-9efd-4bb3-addc-1b0140d14651 response_code = 200 uri = /timesync
9422024-11-22T03:52:31.632ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1732247550.9576492, correction: 0.164056569 } file = sled-agent/src/rack_setup/service.rs:740
9432024-11-22T03:52:31.632ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9442024-11-22T03:52:33.909ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15576343549335075668 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9452024-11-22T03:52:33.909ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6708589135242741314 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9462024-11-22T03:52:34.153ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.328267233s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9472024-11-22T03:52:35.159ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9482024-11-22T03:52:35.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65244
9492024-11-22T03:52:35.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8400 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65244 req_id = b7674a39-d78d-404a-8202-6aa673d97398 response_code = 200 uri = /timesync
9502024-11-22T03:52:35.172ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1732247554.5851042, correction: 0.154370934 } file = sled-agent/src/rack_setup/service.rs:740
9512024-11-22T03:52:35.172ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9522024-11-22T03:52:36.526ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3529012499790410646 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9532024-11-22T03:52:37.223ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15647096492614378618 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9542024-11-22T03:52:37.501ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13889544426170480206 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9552024-11-22T03:52:38.499ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 7130346944604980870 reason = Duration(60s) sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9562024-11-22T03:52:38.500ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 9461343710721793006 reason = Duration(60s) sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9572024-11-22T03:52:38.588ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37770
9582024-11-22T03:52:38.588ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37770 req_id = c813ce50-7250-4899-adb8-55d51a626580 response_code = 200 uri = /baseboard
9592024-11-22T03:52:39.452ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9228039485292536078 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9602024-11-22T03:52:39.452ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14330594990120486476 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9612024-11-22T03:52:43.937ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15576343549335075668 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9622024-11-22T03:52:43.938ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6708589135242741314 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9632024-11-22T03:52:46.452ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9642024-11-22T03:52:46.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33341
9652024-11-22T03:52:46.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9064 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33341 req_id = 4e30a33c-0a69-4976-9bdb-e473b75b4cae response_code = 200 uri = /timesync
9662024-11-22T03:52:46.464ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1732247564.2354906, correction: 0.122744054 } file = sled-agent/src/rack_setup/service.rs:740
9672024-11-22T03:52:46.464ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9682024-11-22T03:52:46.555ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3529012499790410646 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9692024-11-22T03:52:47.251ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15647096492614378618 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9702024-11-22T03:52:47.529ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13889544426170480206 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9712024-11-22T03:52:49.481ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9228039485292536078 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9722024-11-22T03:52:49.482ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14330594990120486476 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9732024-11-22T03:52:50.558ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.060378515s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9742024-11-22T03:52:51.700ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9752024-11-22T03:52:51.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43256
9762024-11-22T03:52:51.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8908 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43256 req_id = aabbdc7a-1b64-461c-a97e-caf9a7cce092 response_code = 200 uri = /timesync
9772024-11-22T03:52:51.711ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1732247570.3944194, correction: 0.108615093 } file = sled-agent/src/rack_setup/service.rs:740
9782024-11-22T03:52:51.711ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9792024-11-22T03:52:53.965ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15576343549335075668 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9802024-11-22T03:52:53.965ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6708589135242741314 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9812024-11-22T03:52:56.582ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3529012499790410646 reason = Duration(60s) sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9822024-11-22T03:52:57.279ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15647096492614378618 reason = Duration(60s) sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9832024-11-22T03:52:57.556ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13889544426170480206 reason = Duration(60s) sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9842024-11-22T03:52:59.509ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9228039485292536078 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9852024-11-22T03:52:59.509ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14330594990120486476 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9862024-11-22T03:53:03.994ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15576343549335075668 reason = Duration(60s) sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9872024-11-22T03:53:03.995ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6708589135242741314 reason = Duration(60s) sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9882024-11-22T03:53:04.511ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9892024-11-22T03:53:04.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61507
9902024-11-22T03:53:04.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8948 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61507 req_id = a2e0baab-07e7-4c94-b04a-1bddfeb407a2 response_code = 200 uri = /timesync
9912024-11-22T03:53:04.523ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1732247582.345043, correction: 0.074460037 } file = sled-agent/src/rack_setup/service.rs:740
9922024-11-22T03:53:04.523ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9932024-11-22T03:53:07.700ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.205337952s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9942024-11-22T03:53:08.700ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61170
9952024-11-22T03:53:08.700ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61170 req_id = 4bb0aeab-3b90-483f-b663-8612e71425fe response_code = 200 uri = /baseboard
9962024-11-22T03:53:09.538ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9228039485292536078 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9972024-11-22T03:53:09.538ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14330594990120486476 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9982024-11-22T03:53:19.567ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9228039485292536078 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
9992024-11-22T03:53:19.567ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14330594990120486476 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
10002024-11-22T03:53:22.524ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10012024-11-22T03:53:22.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44790
10022024-11-22T03:53:22.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21088 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44790 req_id = f8a600a9-51bd-453a-b50a-047dcaa6b0e4 response_code = 200 uri = /timesync
10032024-11-22T03:53:22.546ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T03:53:03.995046056Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6708589135242741314 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
10042024-11-22T03:53:22.547ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T03:52:38.499615879Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 7130346944604980870 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
10052024-11-22T03:53:22.548ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T03:53:03.994616589Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15576343549335075668 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
10062024-11-22T03:53:22.548ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T03:52:38.500174389Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 9461343710721793006 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
10072024-11-22T03:53:22.548ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T03:52:57.279229447Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15647096492614378618 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
10082024-11-22T03:53:22.549ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T03:52:57.556930959Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13889544426170480206 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
10092024-11-22T03:53:22.549ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T03:52:56.582721441Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3529012499790410646 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
10102024-11-22T03:53:22.550ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1732247600.4283206, correction: 0.025602033 } file = sled-agent/src/rack_setup/service.rs:740
10112024-11-22T03:53:22.550ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1425
10122024-11-22T03:53:22.579ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 6f3e43a0-44c3-470b-aeed-59e4d3e6b91a (service), filesystem_pool: Some(ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0a6d4402-4330-4dac-a6fc-1163b7dedc8a (service), filesystem_pool: Some(ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d2bf14c6-9ae0-4e6c-817f-248aabab435c (service), filesystem_pool: Some(ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: e67b4a71-a906-471d-a736-bd080c0ecc30 (service), filesystem_pool: Some(ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4e0f68fb-ad2b-473d-9d7e-84f9e6c88284, kind: Service { id: e67b4a71-a906-471d-a736-bd080c0ecc30 }, name: Name("ntp-e67b4a71-a906-471d-a736-bd080c0ecc30"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 4])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: c277cb07-86ce-4838-985a-c424c0e2c0f1 (service), filesystem_pool: Some(ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0873e8e2-6680-4133-8314-b6422adc2b79 (service), filesystem_pool: Some(ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External } } } }, OmicronZoneConfig { id: 42536afe-8008-446c-bad2-e7eedf60e849 (service), filesystem_pool: Some(ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External } } } }, OmicronZoneConfig { id: fbe837a1-c963-4f54-8db8-4c04cbb4923d (service), filesystem_pool: Some(ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External } } } }, OmicronZoneConfig { id: 676c3021-2d40-4bfe-83c1-84d985bf4df1 (service), filesystem_pool: Some(ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10132024-11-22T03:53:22.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40882
10142024-11-22T03:53:22.580ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10152024-11-22T03:53:22.580ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-zones.json file = common/src/ledger.rs:178
10162024-11-22T03:53:22.580ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-zones.json file = common/src/ledger.rs:178
10172024-11-22T03:53:22.580ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
10182024-11-22T03:53:22.580ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
10192024-11-22T03:53:22.580ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
10202024-11-22T03:53:22.580ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
10212024-11-22T03:53:22.580ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10222024-11-22T03:53:22.667ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10232024-11-22T03:53:22.667ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10242024-11-22T03:53:22.667ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10252024-11-22T03:53:22.667ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10262024-11-22T03:53:22.667ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10272024-11-22T03:53:22.758ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1 file = illumos-utils/src/zone.rs:325
10282024-11-22T03:53:22.762ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1 file = illumos-utils/src/zone.rs:325
10292024-11-22T03:53:22.766ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79 file = illumos-utils/src/zone.rs:325
10302024-11-22T03:53:22.771ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849 file = illumos-utils/src/zone.rs:325
10312024-11-22T03:53:22.776ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d file = illumos-utils/src/zone.rs:325
10322024-11-22T03:53:22.781ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1 file = illumos-utils/src/zone.rs:363
10332024-11-22T03:53:22.785ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1 file = illumos-utils/src/zone.rs:363
10342024-11-22T03:53:22.789ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79 file = illumos-utils/src/zone.rs:363
10352024-11-22T03:53:22.794ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849 file = illumos-utils/src/zone.rs:363
10362024-11-22T03:53:22.799ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d file = illumos-utils/src/zone.rs:363
10372024-11-22T03:53:25.811ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c277cb07-86ce-4838-985a-c424c0e2c0f1'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10382024-11-22T03:53:25.812ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1
10392024-11-22T03:53:25.915ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='fbe837a1-c963-4f54-8db8-4c04cbb4923d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10402024-11-22T03:53:25.915ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
10412024-11-22T03:53:25.923ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='0873e8e2-6680-4133-8314-b6422adc2b79'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10422024-11-22T03:53:25.923ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
10432024-11-22T03:53:25.929ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='676c3021-2d40-4bfe-83c1-84d985bf4df1'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10442024-11-22T03:53:25.929ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
10452024-11-22T03:53:25.942ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='42536afe-8008-446c-bad2-e7eedf60e849'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10462024-11-22T03:53:25.942ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
10472024-11-22T03:53:26.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1") failed: Property not found. retry in 46.559761ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1
10482024-11-22T03:53:26.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1") failed: Property not found. retry in 66.283591ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1
10492024-11-22T03:53:26.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 55.3806ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
10502024-11-22T03:53:26.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d") failed: Property not found. retry in 38.480663ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
10512024-11-22T03:53:26.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1") failed: Property not found. retry in 67.260172ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
10522024-11-22T03:53:26.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849") failed: Property not found. retry in 33.011708ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
10532024-11-22T03:53:26.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1") failed: Property not found. retry in 108.132091ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1
10542024-11-22T03:53:26.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 118.802616ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
10552024-11-22T03:53:26.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d") failed: Property not found. retry in 124.744105ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
10562024-11-22T03:53:26.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1") failed: Property not found. retry in 355.122631ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1
10572024-11-22T03:53:26.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1") failed: Property not found. retry in 51.721894ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
10582024-11-22T03:53:26.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 264.125792ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
10592024-11-22T03:53:26.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849") failed: Property not found. retry in 54.778688ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
10602024-11-22T03:53:26.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d") failed: Property not found. retry in 278.030716ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
10612024-11-22T03:53:26.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1") failed: Property not found. retry in 177.491178ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
10622024-11-22T03:53:26.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849") failed: Property not found. retry in 281.041931ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
10632024-11-22T03:53:26.993ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.017946913s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
10642024-11-22T03:53:27.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 346.958235ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
10652024-11-22T03:53:27.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1") failed: Property not found. retry in 1.198028374s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1
10662024-11-22T03:53:27.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1") failed: Property not found. retry in 584.993387ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
10672024-11-22T03:53:27.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d") failed: Property not found. retry in 533.035677ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
10682024-11-22T03:53:27.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849") failed: Property not found. retry in 474.101621ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
10692024-11-22T03:53:27.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 445.713284ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
10702024-11-22T03:53:27.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1") failed: Property not found. retry in 566.400031ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
10712024-11-22T03:53:27.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849") failed: Property not found. retry in 637.933862ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
10722024-11-22T03:53:27.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d") failed: Property not found. retry in 1.125089903s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
10732024-11-22T03:53:27.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 1.33951435s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
10742024-11-22T03:53:28.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1") failed: Property not found. retry in 1.024407449s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
10752024-11-22T03:53:28.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1") failed: Property not found. retry in 1.45612465s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1
10762024-11-22T03:53:28.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849") failed: Property not found. retry in 761.093794ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
10772024-11-22T03:53:28.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d") failed: Property not found. retry in 1.236107157s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
10782024-11-22T03:53:29.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849") failed: Property not found. retry in 768.429172ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
10792024-11-22T03:53:29.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 773.998837ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
10802024-11-22T03:53:29.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1") failed: Property not found. retry in 1.045799853s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
10812024-11-22T03:53:29.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1") failed: Property not found. retry in 639.304181ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1
10822024-11-22T03:53:29.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849") failed: Property not found. retry in 1.064182611s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
10832024-11-22T03:53:30.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 1.427815327s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
10842024-11-22T03:53:30.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d") failed: Property not found. retry in 1.321316431s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
10852024-11-22T03:53:30.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1") failed: Property not found. retry in 1.494900423s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
10862024-11-22T03:53:30.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1") failed: Property not found. retry in 1.437492273s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1
10872024-11-22T03:53:31.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849") failed: Property not found. retry in 929.972451ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
10882024-11-22T03:53:31.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d") failed: Property not found. retry in 1.429945947s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
10892024-11-22T03:53:31.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 618.831047ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
10902024-11-22T03:53:31.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1") failed: Property not found. retry in 1.339681061s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1
10912024-11-22T03:53:31.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1") failed: Property not found. retry in 1.487468843s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
10922024-11-22T03:53:32.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849") failed: Property not found. retry in 644.839366ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
10932024-11-22T03:53:32.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 706.815344ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
10942024-11-22T03:53:32.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849") failed: Property not found. retry in 925.160267ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
10952024-11-22T03:53:32.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 698.725068ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
10962024-11-22T03:53:32.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d") failed: Property not found. retry in 723.10062ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
10972024-11-22T03:53:33.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1") failed: Property not found. retry in 776.154402ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1
10982024-11-22T03:53:33.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1") failed: Property not found. retry in 1.417095228s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
10992024-11-22T03:53:33.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 1.028177376s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
11002024-11-22T03:53:33.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849") failed: Property not found. retry in 771.028649ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
11012024-11-22T03:53:33.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d") failed: Property not found. retry in 646.890887ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
11022024-11-22T03:53:34.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1") failed: Property not found. retry in 1.174644541s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1
11032024-11-22T03:53:34.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d") failed: Property not found. retry in 969.466818ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
11042024-11-22T03:53:34.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849") failed: Property not found. retry in 1.304958933s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
11052024-11-22T03:53:34.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 1.01391612s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
11062024-11-22T03:53:34.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1") failed: Property not found. retry in 1.257712869s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
11072024-11-22T03:53:35.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1") failed: Property not found. retry in 1.408395383s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1
11082024-11-22T03:53:35.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d") failed: Property not found. retry in 658.719076ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
11092024-11-22T03:53:35.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 614.496237ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
11102024-11-22T03:53:35.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849") failed: Property not found. retry in 1.071708985s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
11112024-11-22T03:53:36.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d") failed: Property not found. retry in 1.110089436s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
11122024-11-22T03:53:36.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1") failed: Property not found. retry in 566.624163ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
11132024-11-22T03:53:36.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 637.06647ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
11142024-11-22T03:53:36.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1") failed: Property not found. retry in 692.384726ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1
11152024-11-22T03:53:36.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1") failed: Property not found. retry in 857.703898ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
11162024-11-22T03:53:36.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849") failed: Property not found. retry in 720.679511ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
11172024-11-22T03:53:36.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 1.058096425s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
11182024-11-22T03:53:37.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d") failed: Property not found. retry in 882.314824ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
11192024-11-22T03:53:37.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1") failed: Property not found. retry in 1.078675782s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1
11202024-11-22T03:53:37.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849") failed: Property not found. retry in 1.43435854s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
11212024-11-22T03:53:37.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1") failed: Property not found. retry in 1.120976159s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
11222024-11-22T03:53:37.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79") failed: Property not found. retry in 827.422208ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
11232024-11-22T03:53:38.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d") failed: Property not found. retry in 1.151464013s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
11242024-11-22T03:53:38.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1") failed: Property not found. retry in 627.243967ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
11252024-11-22T03:53:38.796ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48366
11262024-11-22T03:53:38.796ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48366 req_id = cde8d0d7-663a-4112-bc72-e6a279bb3266 response_code = 200 uri = /baseboard
11272024-11-22T03:53:39.385ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_c277cb07-86ce-4838-985a-c424c0e2c0f1
11282024-11-22T03:53:39.385ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_676c3021-2d40-4bfe-83c1-84d985bf4df1
11292024-11-22T03:53:39.385ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79
11302024-11-22T03:53:39.385ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_42536afe-8008-446c-bad2-e7eedf60e849
11312024-11-22T03:53:39.385ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_fbe837a1-c963-4f54-8db8-4c04cbb4923d
11322024-11-22T03:53:39.385ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
11332024-11-22T03:53:39.385ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-zones.json"
11342024-11-22T03:53:39.385ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
11352024-11-22T03:53:39.385ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-zones.json"
11362024-11-22T03:53:39.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16780315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40882 req_id = 1f41a028-7fb2-4410-85e2-c0bdd77bb7b2 response_code = 204 uri = /omicron-zones
11372024-11-22T03:53:39.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37598
11382024-11-22T03:53:39.450ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29936 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37598 req_id = 516224fc-670a-41b1-8bba-43ef5228aef5 response_code = 500 uri = /cockroachdb
11392024-11-22T03:53:39.451ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "516224fc-670a-41b1-8bba-43ef5228aef5", "content-length": "124", "date": "Fri, 22 Nov 2024 03:53:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "516224fc-670a-41b1-8bba-43ef5228aef5" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 77.855643ms
11402024-11-22T03:53:39.557ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27416 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37598 req_id = c3f6f1f8-70a8-49e6-911a-f42bd4318bd9 response_code = 500 uri = /cockroachdb
11412024-11-22T03:53:39.558ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c3f6f1f8-70a8-49e6-911a-f42bd4318bd9", "content-length": "124", "date": "Fri, 22 Nov 2024 03:53:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c3f6f1f8-70a8-49e6-911a-f42bd4318bd9" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 159.394541ms
11422024-11-22T03:53:39.747ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28774 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37598 req_id = 278a06c5-d3be-4018-a747-88f8a661b136 response_code = 500 uri = /cockroachdb
11432024-11-22T03:53:39.747ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "278a06c5-d3be-4018-a747-88f8a661b136", "content-length": "124", "date": "Fri, 22 Nov 2024 03:53:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "278a06c5-d3be-4018-a747-88f8a661b136" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 91.652942ms
11442024-11-22T03:53:39.868ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27796 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37598 req_id = 28545d27-88bf-4bfa-afc6-42cc7cc0ed67 response_code = 500 uri = /cockroachdb
11452024-11-22T03:53:39.868ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "28545d27-88bf-4bfa-afc6-42cc7cc0ed67", "content-length": "124", "date": "Fri, 22 Nov 2024 03:53:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "28545d27-88bf-4bfa-afc6-42cc7cc0ed67" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 124.965802ms
11462024-11-22T03:53:40.021ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26644 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37598 req_id = 4eaa037e-f0d6-4a84-8f88-2e93486a8499 response_code = 500 uri = /cockroachdb
11472024-11-22T03:53:40.021ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4eaa037e-f0d6-4a84-8f88-2e93486a8499", "content-length": "124", "date": "Fri, 22 Nov 2024 03:53:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4eaa037e-f0d6-4a84-8f88-2e93486a8499" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 207.347088ms
11482024-11-22T03:53:40.257ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26647 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37598 req_id = aeb946d8-447b-46c0-ba19-463c876a2dd2 response_code = 500 uri = /cockroachdb
11492024-11-22T03:53:40.257ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "aeb946d8-447b-46c0-ba19-463c876a2dd2", "content-length": "124", "date": "Fri, 22 Nov 2024 03:53:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "aeb946d8-447b-46c0-ba19-463c876a2dd2" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 197.745202ms
11502024-11-22T03:53:40.482ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25804 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37598 req_id = ebc766d9-6cde-4ed6-b57d-c2020df2a086 response_code = 500 uri = /cockroachdb
11512024-11-22T03:53:40.482ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ebc766d9-6cde-4ed6-b57d-c2020df2a086", "content-length": "124", "date": "Fri, 22 Nov 2024 03:53:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ebc766d9-6cde-4ed6-b57d-c2020df2a086" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 240.735461ms
11522024-11-22T03:53:40.749ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25548 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37598 req_id = 36bdc89d-afc8-4a48-a9db-30b4626ea22a response_code = 500 uri = /cockroachdb
11532024-11-22T03:53:40.749ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "36bdc89d-afc8-4a48-a9db-30b4626ea22a", "content-length": "124", "date": "Fri, 22 Nov 2024 03:53:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "36bdc89d-afc8-4a48-a9db-30b4626ea22a" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 410.766867ms
11542024-11-22T03:53:41.191ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 30384 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37598 req_id = b0528769-e7c0-454d-a648-8902339eeadd response_code = 500 uri = /cockroachdb
11552024-11-22T03:53:41.192ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b0528769-e7c0-454d-a648-8902339eeadd", "content-length": "124", "date": "Fri, 22 Nov 2024 03:53:41 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b0528769-e7c0-454d-a648-8902339eeadd" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 550.503559ms
11562024-11-22T03:53:41.768ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_0873e8e2-6680-4133-8314-b6422adc2b79 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25023 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37598 req_id = 025ebb0a-b302-4e08-b948-794c4778d62a response_code = 500 uri = /cockroachdb
11572024-11-22T03:53:41.769ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "025ebb0a-b302-4e08-b948-794c4778d62a", "content-length": "124", "date": "Fri, 22 Nov 2024 03:53:41 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "025ebb0a-b302-4e08-b948-794c4778d62a" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 769.873849ms
11582024-11-22T03:53:42.570ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3801
11592024-11-22T03:54:06.906ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3819
11602024-11-22T03:54:14.208ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3842
11612024-11-22T03:54:14.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31668951 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37598 req_id = 3df92d05-15b0-4c37-b940-bc33a7b4ed6e response_code = 204 uri = /cockroachdb
11622024-11-22T03:54:14.211ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36860
11632024-11-22T03:54:14.212ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 559 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36860 req_id = 257238aa-ef26-4cfd-831d-6429dad2116e response_code = 200 uri = /baseboard
11642024-11-22T03:54:14.222ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 20.405319871s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
11652024-11-22T03:54:14.263ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 6f3e43a0-44c3-470b-aeed-59e4d3e6b91a (service), filesystem_pool: Some(ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0a6d4402-4330-4dac-a6fc-1163b7dedc8a (service), filesystem_pool: Some(ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d2bf14c6-9ae0-4e6c-817f-248aabab435c (service), filesystem_pool: Some(ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: e67b4a71-a906-471d-a736-bd080c0ecc30 (service), filesystem_pool: Some(ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4e0f68fb-ad2b-473d-9d7e-84f9e6c88284, kind: Service { id: e67b4a71-a906-471d-a736-bd080c0ecc30 }, name: Name("ntp-e67b4a71-a906-471d-a736-bd080c0ecc30"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 4])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: c277cb07-86ce-4838-985a-c424c0e2c0f1 (service), filesystem_pool: Some(ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0873e8e2-6680-4133-8314-b6422adc2b79 (service), filesystem_pool: Some(ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External } } } }, OmicronZoneConfig { id: 42536afe-8008-446c-bad2-e7eedf60e849 (service), filesystem_pool: Some(ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External } } } }, OmicronZoneConfig { id: fbe837a1-c963-4f54-8db8-4c04cbb4923d (service), filesystem_pool: Some(ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External } } } }, OmicronZoneConfig { id: 676c3021-2d40-4bfe-83c1-84d985bf4df1 (service), filesystem_pool: Some(ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External } } } }, OmicronZoneConfig { id: bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b (service), filesystem_pool: Some(ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 2abf54e3-2c6c-44eb-b0e3-3fc421a14a03, kind: Service { id: bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b }, name: Name("external-dns-bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 102])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: da108ce4-fade-4cd8-8ba2-9af291527495 (service), filesystem_pool: Some(ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 93f11b6b-2dce-465c-b2b0-dad36b7143b0, kind: Service { id: da108ce4-fade-4cd8-8ba2-9af291527495 }, name: Name("external-dns-da108ce4-fade-4cd8-8ba2-9af291527495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 7c7e9efe-c39f-4953-97de-f8eafd979b1a (service), filesystem_pool: Some(ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 941af30c-f81b-4662-9f74-f275a9cf5c7d, kind: Service { id: 7c7e9efe-c39f-4953-97de-f8eafd979b1a }, name: Name("nexus-7c7e9efe-c39f-4953-97de-f8eafd979b1a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: da73a142-bb8b-46e7-9b17-ceac40c41577 (service), filesystem_pool: Some(ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 6d6f13dd-aee1-4596-bad2-e4f9d9529231, kind: Service { id: da73a142-bb8b-46e7-9b17-ceac40c41577 }, name: Name("nexus-da73a142-bb8b-46e7-9b17-ceac40c41577"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 8af2b85f-6ab3-4781-9033-075825f48255 (service), filesystem_pool: Some(ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 33ae9477-921f-41c3-9ac3-5632e24c2bfe, kind: Service { id: 8af2b85f-6ab3-4781-9033-075825f48255 }, name: Name("nexus-8af2b85f-6ab3-4781-9033-075825f48255"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 619dee3a-9d47-45ec-a665-d347c721dbd7 (service), filesystem_pool: Some(ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 22986ef2-da93-49a2-bc75-1c62d5271417 (service), filesystem_pool: Some(ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 955e54fa-e11c-4c5c-915c-0460c41c8fcf (service), filesystem_pool: Some(ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 907fe96e-4093-499a-8157-51f29c1e7b1e (service), filesystem_pool: Some(ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 7cb18011-75e7-445d-8003-c778e2e45a49 (service), filesystem_pool: Some(ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: a176dba4-03f5-49d2-a8e5-bcfdcb6c623c (service), filesystem_pool: Some(ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 025504a9-ffb7-432f-85ec-94ed33e3a4fe (service), filesystem_pool: Some(ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External } } } }, OmicronZoneConfig { id: 541ef06e-9d5a-43e8-887a-1ca5db63a109 (service), filesystem_pool: Some(ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External } } } }, OmicronZoneConfig { id: dbc56be9-a701-4a9d-8b04-9952e404bd37 (service), filesystem_pool: Some(ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External } } } }, OmicronZoneConfig { id: 62f205d1-8ee5-48b3-a3dd-db89010d3d29 (service), filesystem_pool: Some(ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External } } } }, OmicronZoneConfig { id: ee514829-44f3-4625-9b09-30933d8b5d9d (service), filesystem_pool: Some(ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External } } } }, OmicronZoneConfig { id: 878393f9-ce69-4ee2-88d4-cba480ed475b (service), filesystem_pool: Some(ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External } } } }, OmicronZoneConfig { id: 350c0410-886d-456d-a744-40fbedb58b6f (service), filesystem_pool: Some(ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External } } } }, OmicronZoneConfig { id: ac5d0423-0a42-4cbf-aff8-57207b333ac9 (service), filesystem_pool: Some(ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
11662024-11-22T03:54:14.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53132
11672024-11-22T03:54:14.264ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11682024-11-22T03:54:14.264ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-zones.json file = common/src/ledger.rs:178
11692024-11-22T03:54:14.265ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-zones.json file = common/src/ledger.rs:178
11702024-11-22T03:54:14.265ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
11712024-11-22T03:54:14.265ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
11722024-11-22T03:54:14.266ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
11732024-11-22T03:54:14.266ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
11742024-11-22T03:54:14.267ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11752024-11-22T03:54:14.388ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11762024-11-22T03:54:14.389ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11772024-11-22T03:54:14.416ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11782024-11-22T03:54:14.416ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11792024-11-22T03:54:14.416ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11802024-11-22T03:54:14.442ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11812024-11-22T03:54:14.442ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11822024-11-22T03:54:14.442ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11832024-11-22T03:54:14.442ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11842024-11-22T03:54:14.455ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11852024-11-22T03:54:14.620ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11862024-11-22T03:54:14.620ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11872024-11-22T03:54:14.620ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11882024-11-22T03:54:14.620ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11892024-11-22T03:54:14.646ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11902024-11-22T03:54:14.646ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11912024-11-22T03:54:14.673ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11922024-11-22T03:54:14.673ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11932024-11-22T03:54:14.673ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11942024-11-22T03:54:14.673ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf file = illumos-utils/src/zone.rs:325
11952024-11-22T03:54:14.679ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9 file = illumos-utils/src/zone.rs:325
11962024-11-22T03:54:14.685ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d file = illumos-utils/src/zone.rs:325
11972024-11-22T03:54:14.691ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c file = illumos-utils/src/zone.rs:325
11982024-11-22T03:54:14.697ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7 file = illumos-utils/src/zone.rs:325
11992024-11-22T03:54:14.703ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417 file = illumos-utils/src/zone.rs:325
12002024-11-22T03:54:14.708ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49 file = illumos-utils/src/zone.rs:325
12012024-11-22T03:54:14.863ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf file = illumos-utils/src/zone.rs:363
12022024-11-22T03:54:14.867ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9 file = illumos-utils/src/zone.rs:363
12032024-11-22T03:54:14.872ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d file = illumos-utils/src/zone.rs:363
12042024-11-22T03:54:14.877ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c file = illumos-utils/src/zone.rs:363
12052024-11-22T03:54:14.881ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7 file = illumos-utils/src/zone.rs:363
12062024-11-22T03:54:14.886ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417 file = illumos-utils/src/zone.rs:363
12072024-11-22T03:54:14.891ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49 file = illumos-utils/src/zone.rs:363
12082024-11-22T03:54:14.896ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37 file = illumos-utils/src/zone.rs:325
12092024-11-22T03:54:14.901ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b file = illumos-utils/src/zone.rs:325
12102024-11-22T03:54:14.907ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe file = illumos-utils/src/zone.rs:325
12112024-11-22T03:54:14.911ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109 file = illumos-utils/src/zone.rs:325
12122024-11-22T03:54:14.917ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e file = illumos-utils/src/zone.rs:325
12132024-11-22T03:54:14.923ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29 file = illumos-utils/src/zone.rs:325
12142024-11-22T03:54:14.929ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f file = illumos-utils/src/zone.rs:325
12152024-11-22T03:54:14.935ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37 file = illumos-utils/src/zone.rs:363
12162024-11-22T03:54:14.942ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b file = illumos-utils/src/zone.rs:363
12172024-11-22T03:54:14.949ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe file = illumos-utils/src/zone.rs:363
12182024-11-22T03:54:14.957ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109 file = illumos-utils/src/zone.rs:363
12192024-11-22T03:54:14.965ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e file = illumos-utils/src/zone.rs:363
12202024-11-22T03:54:14.975ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29 file = illumos-utils/src/zone.rs:363
12212024-11-22T03:54:14.994ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f file = illumos-utils/src/zone.rs:363
12222024-11-22T03:54:15.104ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12232024-11-22T03:54:15.211ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12242024-11-22T03:54:15.280ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12252024-11-22T03:54:15.350ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12262024-11-22T03:54:15.412ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12272024-11-22T03:54:15.414ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12282024-11-22T03:54:15.414ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12292024-11-22T03:54:15.473ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 188, 34]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12302024-11-22T03:54:15.473ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = external_dns
12312024-11-22T03:54:15.476ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12322024-11-22T03:54:15.476ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12332024-11-22T03:54:15.531ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 199, 25]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12342024-11-22T03:54:15.531ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
12352024-11-22T03:54:15.533ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12362024-11-22T03:54:15.533ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12372024-11-22T03:54:15.585ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 222, 183]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12382024-11-22T03:54:15.585ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
12392024-11-22T03:54:15.587ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12402024-11-22T03:54:15.587ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12412024-11-22T03:54:15.640ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 244, 102]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12422024-11-22T03:54:15.640ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = external_dns
12432024-11-22T03:54:15.640ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
12442024-11-22T03:54:15.640ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
12452024-11-22T03:54:15.642ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12462024-11-22T03:54:15.642ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12472024-11-22T03:54:15.696ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 130, 233]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12482024-11-22T03:54:15.696ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
12492024-11-22T03:54:15.697ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12502024-11-22T03:54:15.700ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12512024-11-22T03:54:15.749ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
12522024-11-22T03:54:15.750ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
12532024-11-22T03:54:15.750ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
12542024-11-22T03:54:15.750ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
12552024-11-22T03:54:15.750ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
12562024-11-22T03:54:15.750ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
12572024-11-22T03:54:15.750ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
12582024-11-22T03:54:15.750ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12592024-11-22T03:54:15.751ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12602024-11-22T03:54:15.756ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12612024-11-22T03:54:15.759ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
12622024-11-22T03:54:15.760ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12632024-11-22T03:54:15.760ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12642024-11-22T03:54:15.762ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12652024-11-22T03:54:15.765ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12662024-11-22T03:54:15.765ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12672024-11-22T03:54:15.997ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495 file = illumos-utils/src/zone.rs:325
12682024-11-22T03:54:16.009ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255 file = illumos-utils/src/zone.rs:325
12692024-11-22T03:54:16.020ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a file = illumos-utils/src/zone.rs:325
12702024-11-22T03:54:16.029ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577 file = illumos-utils/src/zone.rs:325
12712024-11-22T03:54:16.041ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b file = illumos-utils/src/zone.rs:325
12722024-11-22T03:54:16.053ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495 file = illumos-utils/src/zone.rs:363
12732024-11-22T03:54:16.064ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255 file = illumos-utils/src/zone.rs:363
12742024-11-22T03:54:16.079ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a file = illumos-utils/src/zone.rs:363
12752024-11-22T03:54:16.083ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577 file = illumos-utils/src/zone.rs:363
12762024-11-22T03:54:16.092ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b file = illumos-utils/src/zone.rs:363
12772024-11-22T03:54:19.414ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12782024-11-22T03:54:19.415ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
12792024-11-22T03:54:19.602ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f13a1c2f-8642-4111-9bab-2dc9809f2e5b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a8d65ec8-583d-47f1-b88e-3caf067a3ebe'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12802024-11-22T03:54:19.602ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='11d24285-0f0f-48f4-a8f8-45edcd78e370'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12812024-11-22T03:54:19.602ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
12822024-11-22T03:54:19.606ZINFOSledAgent (ServiceManager): Booting oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
12832024-11-22T03:54:19.615ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_48b787c2-7c89-4a59-9296-d71ece8b8529/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8d2c210f-6ab9-44c2-a239-ba1ac4def956'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12842024-11-22T03:54:19.615ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1182b0f1-244a-4bba-979c-4840fa5a1132/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8d9502c0-92e2-4649-aae6-c820386f028e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12852024-11-22T03:54:19.616ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_157e7505-0f5f-4cc6-9939-e8c05827bf3d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c8c41f7d-029e-4fa5-8395-2892dd42e83a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12862024-11-22T03:54:19.616ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_79b89e7a-03ea-4602-9f51-01fb67551168/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8e4bfbd6-4b9d-4edf-b6d9-71fbae163669'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12872024-11-22T03:54:19.616ZINFOSledAgent (ServiceManager): Booting oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
12882024-11-22T03:54:19.623ZINFOSledAgent (ServiceManager): Booting oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
12892024-11-22T03:54:19.630ZINFOSledAgent (ServiceManager): Booting oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
12902024-11-22T03:54:19.636ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
12912024-11-22T03:54:19.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 49.797617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
12922024-11-22T03:54:19.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 30.597286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
12932024-11-22T03:54:19.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 58.101214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
12942024-11-22T03:54:19.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 25.720971ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
12952024-11-22T03:54:19.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 47.70196ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
12962024-11-22T03:54:19.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 79.057738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
12972024-11-22T03:54:19.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 66.305834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
12982024-11-22T03:54:19.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 69.53037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
12992024-11-22T03:54:20.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 90.51412ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
13002024-11-22T03:54:20.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 129.960351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
13012024-11-22T03:54:20.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 227.281952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
13022024-11-22T03:54:20.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 132.03989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
13032024-11-22T03:54:20.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 142.166374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
13042024-11-22T03:54:20.224ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='619dee3a-9d47-45ec-a665-d347c721dbd7'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13052024-11-22T03:54:20.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 148.113123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
13062024-11-22T03:54:20.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 84.275836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
13072024-11-22T03:54:20.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 66.847357ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
13082024-11-22T03:54:20.305ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
13092024-11-22T03:54:20.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 132.292209ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
13102024-11-22T03:54:20.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 177.484108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
13112024-11-22T03:54:20.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 466.376497ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
13122024-11-22T03:54:20.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 277.936049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
13132024-11-22T03:54:20.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 262.232824ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
13142024-11-22T03:54:20.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 252.34149ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
13152024-11-22T03:54:20.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 237.308773ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
13162024-11-22T03:54:20.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 384.58892ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
13172024-11-22T03:54:20.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 363.123493ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
13182024-11-22T03:54:28.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 237.402452ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
13192024-11-22T03:54:28.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 612.291986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
13202024-11-22T03:54:28.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 562.998177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
13212024-11-22T03:54:28.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 558.912798ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
13222024-11-22T03:54:28.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 67.216355ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
13232024-11-22T03:54:28.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 1.077412235s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
13242024-11-22T03:54:29.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 1.111655132s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
13252024-11-22T03:54:29.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 238.940714ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
13262024-11-22T03:54:29.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 264.9163ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
13272024-11-22T03:54:29.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 56.952988ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
13282024-11-22T03:54:29.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 135.286039ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
13292024-11-22T03:54:29.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 936.678106ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
13302024-11-22T03:54:29.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 399.987425ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
13312024-11-22T03:54:29.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 1.180876635s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
13322024-11-22T03:54:29.381ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13332024-11-22T03:54:29.381ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
13342024-11-22T03:54:29.388ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13352024-11-22T03:54:29.389ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
13362024-11-22T03:54:29.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 666.60499ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
13372024-11-22T03:54:29.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 1.399623171s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
13382024-11-22T03:54:29.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 951.685514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
13392024-11-22T03:54:29.598ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13402024-11-22T03:54:29.600ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13412024-11-22T03:54:29.600ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
13422024-11-22T03:54:29.609ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='50746727-56e1-4143-ba2a-dc417d9cdf85'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13432024-11-22T03:54:29.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 64.814943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
13442024-11-22T03:54:29.617ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='340733bf-ea97-4316-84a1-1dd57654cc97'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13452024-11-22T03:54:29.617ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
13462024-11-22T03:54:29.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 27.384874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
13472024-11-22T03:54:29.633ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e4f74c89-1963-417c-814f-cb22f8634b05/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='92df5aa3-fd00-439a-8ae4-b429b3f1ae61'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13482024-11-22T03:54:29.633ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
13492024-11-22T03:54:29.638ZINFOSledAgent (ServiceManager): Booting oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
13502024-11-22T03:54:29.644ZINFOSledAgent (ServiceManager): Booting oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
13512024-11-22T03:54:29.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 142.077944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
13522024-11-22T03:54:29.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 131.682439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
13532024-11-22T03:54:29.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 478.976474ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
13542024-11-22T03:54:29.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 208.871569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
13552024-11-22T03:54:29.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 138.838744ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
13562024-11-22T03:54:30.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 44.13495ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
13572024-11-22T03:54:30.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 969.796813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
13582024-11-22T03:54:30.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 333.171139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
13592024-11-22T03:54:30.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 1.393924131s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
13602024-11-22T03:54:30.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 947.444771ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
13612024-11-22T03:54:30.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 35.999575ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
13622024-11-22T03:54:30.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 73.905833ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
13632024-11-22T03:54:30.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 215.645672ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
13642024-11-22T03:54:30.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 57.127976ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
13652024-11-22T03:54:30.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 89.903311ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
13662024-11-22T03:54:30.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 27.347029ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
13672024-11-22T03:54:30.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 1.303488729s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
13682024-11-22T03:54:30.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 112.259048ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
13692024-11-22T03:54:30.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 822.724824ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
13702024-11-22T03:54:30.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 62.701649ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
13712024-11-22T03:54:30.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 1.09341676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
13722024-11-22T03:54:30.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 1.096323819s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
13732024-11-22T03:54:30.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 62.666289ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
13742024-11-22T03:54:30.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 257.610456ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
13752024-11-22T03:54:30.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 632.422391ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
13762024-11-22T03:54:30.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 99.172062ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
13772024-11-22T03:54:30.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 1.126995346s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
13782024-11-22T03:54:30.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 141.727136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
13792024-11-22T03:54:30.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 281.569929ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
13802024-11-22T03:54:30.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 298.326514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
13812024-11-22T03:54:30.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 292.28023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
13822024-11-22T03:54:30.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 481.346543ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
13832024-11-22T03:54:30.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 1.48271322s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
13842024-11-22T03:54:30.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 405.162688ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
13852024-11-22T03:54:30.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 473.590431ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
13862024-11-22T03:54:31.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 213.497339ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
13872024-11-22T03:54:31.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 531.329846ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
13882024-11-22T03:54:31.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 1.018028295s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
13892024-11-22T03:54:31.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 1.064244801s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
13902024-11-22T03:54:31.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 701.354532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
13912024-11-22T03:54:31.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 852.184332ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
13922024-11-22T03:54:31.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 998.97588ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
13932024-11-22T03:54:31.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 977.883938ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
13942024-11-22T03:54:31.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 875.453431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
13952024-11-22T03:54:31.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 1.189928275s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
13962024-11-22T03:54:31.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 1.212784919s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
13972024-11-22T03:54:31.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 871.403756ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
13982024-11-22T03:54:31.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 1.228859223s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
13992024-11-22T03:54:31.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 1.325579541s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
14002024-11-22T03:54:31.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 850.795037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
14012024-11-22T03:54:31.744ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14022024-11-22T03:54:31.746ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14032024-11-22T03:54:31.746ZINFOSledAgent (ServiceManager): Booting oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
14042024-11-22T03:54:31.754ZINFOSledAgent (ServiceManager): Booting oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
14052024-11-22T03:54:31.762ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14062024-11-22T03:54:31.762ZINFOSledAgent (ServiceManager): Booting oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
14072024-11-22T03:54:31.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 622.864963ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
14082024-11-22T03:54:31.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 529.975588ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
14092024-11-22T03:54:32.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 62.664112ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
14102024-11-22T03:54:32.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a") failed: Property not found. retry in 71.525861ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
14112024-11-22T03:54:32.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255") failed: Property not found. retry in 28.573976ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
14122024-11-22T03:54:32.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 131.766534ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
14132024-11-22T03:54:32.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 1.3854689s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
14142024-11-22T03:54:32.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255") failed: Property not found. retry in 146.90102ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
14152024-11-22T03:54:32.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 1.344599788s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
14162024-11-22T03:54:32.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 1.403004158s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
14172024-11-22T03:54:32.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a") failed: Property not found. retry in 128.106961ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
14182024-11-22T03:54:32.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 970.994455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
14192024-11-22T03:54:32.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 999.210374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
14202024-11-22T03:54:32.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 234.24787ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
14212024-11-22T03:54:32.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 577.726899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
14222024-11-22T03:54:32.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 779.153916ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
14232024-11-22T03:54:32.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255") failed: Property not found. retry in 286.390158ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
14242024-11-22T03:54:32.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 1.408504179s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
14252024-11-22T03:54:32.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 1.113283355s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
14262024-11-22T03:54:32.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 713.630905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
14272024-11-22T03:54:32.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a") failed: Property not found. retry in 182.486522ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
14282024-11-22T03:54:32.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 1.197162481s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
14292024-11-22T03:54:32.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 994.623901ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
14302024-11-22T03:54:32.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 556.04194ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
14312024-11-22T03:54:32.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a") failed: Property not found. retry in 344.243564ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
14322024-11-22T03:54:32.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255") failed: Property not found. retry in 342.954757ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
14332024-11-22T03:54:32.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 696.525689ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
14342024-11-22T03:54:32.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 701.896617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
14352024-11-22T03:54:33.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 1.113991593s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
14362024-11-22T03:54:33.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 1.420760245s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
14372024-11-22T03:54:33.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a") failed: Property not found. retry in 454.808663ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
14382024-11-22T03:54:33.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255") failed: Property not found. retry in 903.524466ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
14392024-11-22T03:54:33.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 993.277222ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
14402024-11-22T03:54:33.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 824.103103ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
14412024-11-22T03:54:33.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 1.149894604s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
14422024-11-22T03:54:33.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 662.261469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
14432024-11-22T03:54:33.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 1.128877641s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
14442024-11-22T03:54:33.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 1.187940694s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
14452024-11-22T03:54:33.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 1.232243274s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
14462024-11-22T03:54:33.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a") failed: Property not found. retry in 1.339473204s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
14472024-11-22T03:54:33.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 539.981504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
14482024-11-22T03:54:33.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 1.057648296s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
14492024-11-22T03:54:33.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 1.002586679s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
14502024-11-22T03:54:33.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 1.442263457s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
14512024-11-22T03:54:33.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 1.230748008s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
14522024-11-22T03:54:33.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 1.37933774s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
14532024-11-22T03:54:33.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 1.296675186s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
14542024-11-22T03:54:34.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255") failed: Property not found. retry in 978.195722ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
14552024-11-22T03:54:34.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 1.164094294s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
14562024-11-22T03:54:34.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 1.005206232s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
14572024-11-22T03:54:34.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 595.996749ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
14582024-11-22T03:54:34.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 1.019269363s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
14592024-11-22T03:54:34.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 1.193426693s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
14602024-11-22T03:54:34.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 561.093306ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
14612024-11-22T03:54:34.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 1.25494731s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
14622024-11-22T03:54:34.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 683.004622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
14632024-11-22T03:54:34.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 1.136966402s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
14642024-11-22T03:54:34.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 1.341009471s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
14652024-11-22T03:54:34.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 547.699748ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
14662024-11-22T03:54:34.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 1.065324077s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
14672024-11-22T03:54:34.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 1.122909808s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
14682024-11-22T03:54:34.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a") failed: Property not found. retry in 1.265338112s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
14692024-11-22T03:54:35.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 1.384005416s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
14702024-11-22T03:54:35.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 1.449382458s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
14712024-11-22T03:54:35.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255") failed: Property not found. retry in 898.472592ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
14722024-11-22T03:54:35.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 688.337287ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
14732024-11-22T03:54:35.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 1.121298586s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
14742024-11-22T03:54:35.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 1.213604624s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
14752024-11-22T03:54:35.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 1.362080036s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
14762024-11-22T03:54:35.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 1.231157101s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
14772024-11-22T03:54:35.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 1.414145813s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
14782024-11-22T03:54:35.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 1.3377314s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
14792024-11-22T03:54:35.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 1.054876109s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
14802024-11-22T03:54:35.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 1.164785214s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
14812024-11-22T03:54:35.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 1.470403729s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
14822024-11-22T03:54:35.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 1.237480612s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
14832024-11-22T03:54:35.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 922.58573ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
14842024-11-22T03:54:35.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 984.225456ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
14852024-11-22T03:54:35.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 1.473622739s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
14862024-11-22T03:54:35.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255") failed: Property not found. retry in 539.234518ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
14872024-11-22T03:54:36.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 1.266947939s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
14882024-11-22T03:54:36.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 1.358448314s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
14892024-11-22T03:54:36.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a") failed: Property not found. retry in 743.482105ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
14902024-11-22T03:54:36.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 1.316529929s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
14912024-11-22T03:54:36.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 969.10742ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
14922024-11-22T03:54:36.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 1.282625465s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
14932024-11-22T03:54:36.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 1.279614507s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
14942024-11-22T03:54:36.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 861.659161ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
14952024-11-22T03:54:36.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255") failed: Property not found. retry in 1.396544445s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
14962024-11-22T03:54:36.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 840.151683ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
14972024-11-22T03:54:36.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 1.093352157s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
14982024-11-22T03:54:36.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 1.162412662s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
14992024-11-22T03:54:36.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 1.181015447s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
15002024-11-22T03:54:36.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 889.491429ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
15012024-11-22T03:54:36.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 1.436305036s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
15022024-11-22T03:54:37.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 1.498041691s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
15032024-11-22T03:54:37.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a") failed: Property not found. retry in 1.223140223s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
15042024-11-22T03:54:37.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 1.090545523s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
15052024-11-22T03:54:37.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 1.32888534s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
15062024-11-22T03:54:37.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 1.0193246s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
15072024-11-22T03:54:37.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 1.259696249s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
15082024-11-22T03:54:37.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 1.313000552s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
15092024-11-22T03:54:37.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 1.457954322s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
15102024-11-22T03:54:37.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 618.997156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
15112024-11-22T03:54:37.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 1.498242528s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
15122024-11-22T03:54:37.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 1.096428023s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
15132024-11-22T03:54:37.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 988.143016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
15142024-11-22T03:54:37.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 1.369506428s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
15152024-11-22T03:54:37.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 1.148834813s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
15162024-11-22T03:54:37.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 677.746017ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
15172024-11-22T03:54:37.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 961.213827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
15182024-11-22T03:54:37.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255") failed: Property not found. retry in 682.051304ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
15192024-11-22T03:54:38.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 1.019873201s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
15202024-11-22T03:54:38.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 1.019770987s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
15212024-11-22T03:54:38.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 950.624159ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
15222024-11-22T03:54:38.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a") failed: Property not found. retry in 1.147574584s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
15232024-11-22T03:54:38.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 535.125605ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
15242024-11-22T03:54:38.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 1.112681673s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
15252024-11-22T03:54:38.554ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15262024-11-22T03:54:38.555ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
15272024-11-22T03:54:38.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 1.284581915s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
15282024-11-22T03:54:38.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255") failed: Property not found. retry in 669.37761ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
15292024-11-22T03:54:38.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 649.974559ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
15302024-11-22T03:54:38.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 1.205440497s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
15312024-11-22T03:54:38.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 911.724483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
15322024-11-22T03:54:38.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417") failed: Property not found. retry in 68.679459ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
15332024-11-22T03:54:38.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 786.664016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
15342024-11-22T03:54:38.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417") failed: Property not found. retry in 120.886625ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
15352024-11-22T03:54:38.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 1.023753838s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
15362024-11-22T03:54:38.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 732.574579ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
15372024-11-22T03:54:38.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 1.066776064s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
15382024-11-22T03:54:39.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417") failed: Property not found. retry in 103.358874ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
15392024-11-22T03:54:39.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 1.492867825s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
15402024-11-22T03:54:39.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 1.156280919s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
15412024-11-22T03:54:39.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417") failed: Property not found. retry in 316.440886ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
15422024-11-22T03:54:39.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 1.324157444s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
15432024-11-22T03:54:39.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 565.923243ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
15442024-11-22T03:54:39.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255") failed: Property not found. retry in 1.166513184s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
15452024-11-22T03:54:39.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 1.141150217s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
15462024-11-22T03:54:39.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 539.188469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
15472024-11-22T03:54:39.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 934.91801ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
15482024-11-22T03:54:39.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 1.173741683s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
15492024-11-22T03:54:39.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417") failed: Property not found. retry in 1.159371419s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
15502024-11-22T03:54:39.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a") failed: Property not found. retry in 895.594898ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
15512024-11-22T03:54:39.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 1.428307716s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
15522024-11-22T03:54:39.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 794.290148ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
15532024-11-22T03:54:39.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 797.121214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
15542024-11-22T03:54:39.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 721.363334ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
15552024-11-22T03:54:39.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 1.359030681s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
15562024-11-22T03:54:39.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 1.073615575s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
15572024-11-22T03:54:39.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 594.898608ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
15582024-11-22T03:54:39.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 552.532545ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
15592024-11-22T03:54:39.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 1.266949192s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
15602024-11-22T03:54:40.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 638.240206ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
15612024-11-22T03:54:40.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 1.326885748s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
15622024-11-22T03:54:40.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 1.417116488s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
15632024-11-22T03:54:40.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 727.659765ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
15642024-11-22T03:54:40.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 1.430812844s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
15652024-11-22T03:54:40.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 971.579912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
15662024-11-22T03:54:40.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 925.899544ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
15672024-11-22T03:54:40.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a") failed: Property not found. retry in 1.243090799s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
15682024-11-22T03:54:40.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255") failed: Property not found. retry in 1.06673905s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
15692024-11-22T03:54:40.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 1.15047941s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
15702024-11-22T03:54:40.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 1.217527754s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
15712024-11-22T03:54:40.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 985.982593ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
15722024-11-22T03:54:40.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 876.701374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
15732024-11-22T03:54:40.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 805.280003ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
15742024-11-22T03:54:40.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417") failed: Property not found. retry in 1.457646074s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
15752024-11-22T03:54:40.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 790.729137ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
15762024-11-22T03:54:40.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 820.764394ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
15772024-11-22T03:54:41.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 964.317181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
15782024-11-22T03:54:41.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 658.1831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
15792024-11-22T03:54:41.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 750.126249ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
15802024-11-22T03:54:41.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 1.252964244s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
15812024-11-22T03:54:41.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 636.848689ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
15822024-11-22T03:54:41.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 713.39309ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
15832024-11-22T03:54:41.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 1.130651407s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
15842024-11-22T03:54:41.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 1.437686893s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
15852024-11-22T03:54:41.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 967.03724ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
15862024-11-22T03:54:41.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 991.988995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
15872024-11-22T03:54:41.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255") failed: Property not found. retry in 1.169026731s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
15882024-11-22T03:54:41.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 1.10608737s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
15892024-11-22T03:54:41.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 1.226796818s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
15902024-11-22T03:54:41.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a") failed: Property not found. retry in 503.853885ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
15912024-11-22T03:54:41.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 732.207151ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
15922024-11-22T03:54:41.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 1.130334761s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
15932024-11-22T03:54:41.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 513.97031ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
15942024-11-22T03:54:41.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 937.289599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
15952024-11-22T03:54:41.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 1.296020536s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
15962024-11-22T03:54:41.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 536.824616ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
15972024-11-22T03:54:42.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 1.312040324s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
15982024-11-22T03:54:42.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 1.23550887s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
15992024-11-22T03:54:42.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417") failed: Property not found. retry in 1.45660626s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
16002024-11-22T03:54:42.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 1.196987645s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
16012024-11-22T03:54:42.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a") failed: Property not found. retry in 1.219784853s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
16022024-11-22T03:54:42.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 1.080503304s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
16032024-11-22T03:54:42.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 1.016686373s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
16042024-11-22T03:54:42.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 1.247599638s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
16052024-11-22T03:54:42.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 807.956382ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
16062024-11-22T03:54:42.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 522.46548ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
16072024-11-22T03:54:42.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 666.086947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
16082024-11-22T03:54:42.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 724.436713ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
16092024-11-22T03:54:42.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 589.097811ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
16102024-11-22T03:54:42.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255") failed: Property not found. retry in 1.41511123s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
16112024-11-22T03:54:42.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf") failed: Property not found. retry in 977.844335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
16122024-11-22T03:54:42.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 1.272580901s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
16132024-11-22T03:54:42.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 1.312941242s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
16142024-11-22T03:54:42.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 1.314407357s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
16152024-11-22T03:54:43.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 1.250859705s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
16162024-11-22T03:54:43.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 1.344331488s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
16172024-11-22T03:54:43.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 1.492663842s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
16182024-11-22T03:54:43.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 1.082419652s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
16192024-11-22T03:54:43.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 695.852192ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
16202024-11-22T03:54:43.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 1.333104413s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
16212024-11-22T03:54:43.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29") failed: Property not found. retry in 1.148274254s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
16222024-11-22T03:54:43.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37") failed: Property not found. retry in 706.661744ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
16232024-11-22T03:54:43.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 691.802204ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
16242024-11-22T03:54:43.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 504.19178ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
16252024-11-22T03:54:43.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a") failed: Property not found. retry in 1.32604372s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
16262024-11-22T03:54:43.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 1.386100417s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
16272024-11-22T03:54:43.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417") failed: Property not found. retry in 1.356440661s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
16282024-11-22T03:54:43.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b") failed: Property not found. retry in 884.388649ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
16292024-11-22T03:54:43.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 1.118651213s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
16302024-11-22T03:54:44.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9") failed: Property not found. retry in 750.549613ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
16312024-11-22T03:54:44.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7") failed: Property not found. retry in 943.394735ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
16322024-11-22T03:54:44.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255") failed: Property not found. retry in 952.838889ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
16332024-11-22T03:54:44.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f") failed: Property not found. retry in 1.16059378s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
16342024-11-22T03:54:44.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 987.056532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
16352024-11-22T03:54:44.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d") failed: Property not found. retry in 898.284044ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
16362024-11-22T03:54:44.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495") failed: Property not found. retry in 1.11319679s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
16372024-11-22T03:54:44.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49") failed: Property not found. retry in 1.203225159s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
16382024-11-22T03:54:44.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b") failed: Property not found. retry in 1.492008587s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
16392024-11-22T03:54:44.548ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39504
16402024-11-22T03:54:44.607ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38709 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39504 req_id = a88948e7-c874-4066-8b5b-513bb0df4af3 response_code = 200 uri = /baseboard
16412024-11-22T03:54:44.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e") failed: Property not found. retry in 508.875018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
16422024-11-22T03:54:44.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109") failed: Property not found. retry in 1.062523828s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
16432024-11-22T03:54:44.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a") failed: Property not found. retry in 1.005879111s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
16442024-11-22T03:54:44.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c") failed: Property not found. retry in 1.061094022s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
16452024-11-22T03:54:44.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417") failed: Property not found. retry in 1.120784482s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
16462024-11-22T03:54:45.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577") failed: Property not found. retry in 871.218564ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
16472024-11-22T03:54:45.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe") failed: Property not found. retry in 900.589927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
16482024-11-22T03:54:46.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417") failed: Property not found. retry in 780.632219ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
16492024-11-22T03:54:46.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417") failed: Property not found. retry in 1.33555494s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
16502024-11-22T03:54:48.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417") failed: Property not found. retry in 1.11617832s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
16512024-11-22T03:54:49.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417") failed: Property not found. retry in 968.194034ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
16522024-11-22T03:54:49.762ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 30.480524376s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
16532024-11-22T03:54:50.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417") failed: Property not found. retry in 630.430818ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
16542024-11-22T03:54:51.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417") failed: Property not found. retry in 553.926208ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
16552024-11-22T03:54:51.633ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_955e54fa-e11c-4c5c-915c-0460c41c8fcf
16562024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_external_dns_da108ce4-fade-4cd8-8ba2-9af291527495
16572024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_ac5d0423-0a42-4cbf-aff8-57207b333ac9
16582024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_ee514829-44f3-4625-9b09-30933d8b5d9d
16592024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_8af2b85f-6ab3-4781-9033-075825f48255
16602024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_a176dba4-03f5-49d2-a8e5-bcfdcb6c623c
16612024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_oximeter_619dee3a-9d47-45ec-a665-d347c721dbd7
16622024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_clickhouse_22986ef2-da93-49a2-bc75-1c62d5271417
16632024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_7c7e9efe-c39f-4953-97de-f8eafd979b1a
16642024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_7cb18011-75e7-445d-8003-c778e2e45a49
16652024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_dbc56be9-a701-4a9d-8b04-9952e404bd37
16662024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_878393f9-ce69-4ee2-88d4-cba480ed475b
16672024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_025504a9-ffb7-432f-85ec-94ed33e3a4fe
16682024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_da73a142-bb8b-46e7-9b17-ceac40c41577
16692024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_541ef06e-9d5a-43e8-887a-1ca5db63a109
16702024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_external_dns_bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b
16712024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_907fe96e-4093-499a-8157-51f29c1e7b1e
16722024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_62f205d1-8ee5-48b3-a3dd-db89010d3d29
16732024-11-22T03:54:51.634ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_350c0410-886d-456d-a744-40fbedb58b6f
16742024-11-22T03:54:51.639ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
16752024-11-22T03:54:51.644ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-zones.json"
16762024-11-22T03:54:51.644ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
16772024-11-22T03:54:51.646ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-zones.json"
16782024-11-22T03:54:51.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37382853 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53132 req_id = 0b5e42f9-6377-4cee-9240-7d39dc15d8a5 response_code = 204 uri = /omicron-zones
16792024-11-22T03:54:51.707ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1448
16802024-11-22T03:54:51.712ZINFOSledAgent (RSS): Writing ledger to /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:200
16812024-11-22T03:54:51.712ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/rss-plan-completed.marker"
16822024-11-22T03:54:51.712ZINFOSledAgent (RSS): Writing ledger to /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:200
16832024-11-22T03:54:51.712ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/rss-plan-completed.marker"
16842024-11-22T03:54:51.732ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
16852024-11-22T03:54:51.746ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:799
16862024-11-22T03:54:51.780ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1013
16872024-11-22T03:54:51.795ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cccdefe3-2bc4-4184-8dc4-7e505090a7b9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16882024-11-22T03:54:51.921ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cccdefe3-2bc4-4184-8dc4-7e505090a7b9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16892024-11-22T03:54:52.100ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cccdefe3-2bc4-4184-8dc4-7e505090a7b9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16902024-11-22T03:54:52.279ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cccdefe3-2bc4-4184-8dc4-7e505090a7b9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16912024-11-22T03:54:52.418ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cccdefe3-2bc4-4184-8dc4-7e505090a7b9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16922024-11-22T03:54:52.595ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cccdefe3-2bc4-4184-8dc4-7e505090a7b9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16932024-11-22T03:54:52.836ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cccdefe3-2bc4-4184-8dc4-7e505090a7b9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16942024-11-22T03:54:53.233ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cccdefe3-2bc4-4184-8dc4-7e505090a7b9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16952024-11-22T03:54:53.600ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cccdefe3-2bc4-4184-8dc4-7e505090a7b9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16962024-11-22T03:54:54.145ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cccdefe3-2bc4-4184-8dc4-7e505090a7b9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16972024-11-22T03:54:54.704ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/cccdefe3-2bc4-4184-8dc4-7e505090a7b9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
16982024-11-22T03:54:56.390ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c8e7bd67-9c70-4546-a97c-38558959a043", "content-length": "173", "date": "Fri, 22 Nov 2024 03:54:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"cccdefe3-2bc4-4184-8dc4-7e505090a7b9\"", request_id: "c8e7bd67-9c70-4546-a97c-38558959a043" } file = sled-agent/src/rack_setup/service.rs:1075
16992024-11-22T03:54:57.332ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "aea4ec4f-bb74-4848-a4a8-54178db3efa7", "content-length": "173", "date": "Fri, 22 Nov 2024 03:54:57 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"cccdefe3-2bc4-4184-8dc4-7e505090a7b9\"", request_id: "aea4ec4f-bb74-4848-a4a8-54178db3efa7" } file = sled-agent/src/rack_setup/service.rs:1075
17002024-11-22T03:54:59.503ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "bc2aca15-dc1e-4fe9-b7f7-3459a34ac275", "content-length": "173", "date": "Fri, 22 Nov 2024 03:54:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fcd04c0f-1471-4403-b8d9-fe281f829465\"", request_id: "bc2aca15-dc1e-4fe9-b7f7-3459a34ac275" } file = sled-agent/src/rack_setup/service.rs:1075
17012024-11-22T03:55:01.570ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3d2e6605-3757-4812-a532-645372a14b8e", "content-length": "173", "date": "Fri, 22 Nov 2024 03:55:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fcd04c0f-1471-4403-b8d9-fe281f829465\"", request_id: "3d2e6605-3757-4812-a532-645372a14b8e" } file = sled-agent/src/rack_setup/service.rs:1075
17022024-11-22T03:55:04.164ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a3d048d6-ae53-4168-bf99-f2e36f7aca8f", "content-length": "173", "date": "Fri, 22 Nov 2024 03:55:04 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fcd04c0f-1471-4403-b8d9-fe281f829465\"", request_id: "a3d048d6-ae53-4168-bf99-f2e36f7aca8f" } file = sled-agent/src/rack_setup/service.rs:1075
17032024-11-22T03:55:05.890ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0942fd25-2707-439d-bddd-1663fb475655", "content-length": "173", "date": "Fri, 22 Nov 2024 03:55:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fcd04c0f-1471-4403-b8d9-fe281f829465\"", request_id: "0942fd25-2707-439d-bddd-1663fb475655" } file = sled-agent/src/rack_setup/service.rs:1075
17042024-11-22T03:55:06.852ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
17052024-11-22T03:55:06.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48821
17062024-11-22T03:55:07.002ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17072024-11-22T03:55:07.002ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17082024-11-22T03:55:07.003ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-zones.json file = common/src/ledger.rs:178
17092024-11-22T03:55:07.005ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-zones.json file = common/src/ledger.rs:178
17102024-11-22T03:55:07.019ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17112024-11-22T03:55:07.019ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0
17122024-11-22T03:55:07.043ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17132024-11-22T03:55:07.043ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363
17142024-11-22T03:55:07.064ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17152024-11-22T03:55:07.064ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_1182b0f1-244a-4bba-979c-4840fa5a1132
17162024-11-22T03:55:07.087ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17172024-11-22T03:55:07.087ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f
17182024-11-22T03:55:07.107ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17192024-11-22T03:55:07.107ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_157e7505-0f5f-4cc6-9939-e8c05827bf3d
17202024-11-22T03:55:07.128ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17212024-11-22T03:55:07.128ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f13a1c2f-8642-4111-9bab-2dc9809f2e5b
17222024-11-22T03:55:07.148ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17232024-11-22T03:55:07.148ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_48b787c2-7c89-4a59-9296-d71ece8b8529
17242024-11-22T03:55:07.167ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17252024-11-22T03:55:07.167ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e4f74c89-1963-417c-814f-cb22f8634b05
17262024-11-22T03:55:07.188ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17272024-11-22T03:55:07.188ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_79b89e7a-03ea-4602-9f51-01fb67551168
17282024-11-22T03:55:07.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201786 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48821 req_id = c7f5226d-494a-48ae-890a-a56e705f9078 response_code = 200 uri = /inventory
17292024-11-22T03:55:09.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44920
17302024-11-22T03:55:09.239ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2abf54e3-2c6c-44eb-b0e3-3fc421a14a03, kind: Service { id: bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b }, name: Name("external-dns-bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 102])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93f11b6b-2dce-465c-b2b0-dad36b7143b0, kind: Service { id: da108ce4-fade-4cd8-8ba2-9af291527495 }, name: Name("external-dns-da108ce4-fade-4cd8-8ba2-9af291527495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33ae9477-921f-41c3-9ac3-5632e24c2bfe, kind: Service { id: 8af2b85f-6ab3-4781-9033-075825f48255 }, name: Name("nexus-8af2b85f-6ab3-4781-9033-075825f48255"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6f13dd-aee1-4596-bad2-e4f9d9529231, kind: Service { id: da73a142-bb8b-46e7-9b17-ceac40c41577 }, name: Name("nexus-da73a142-bb8b-46e7-9b17-ceac40c41577"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 941af30c-f81b-4662-9f74-f275a9cf5c7d, kind: Service { id: 7c7e9efe-c39f-4953-97de-f8eafd979b1a }, name: Name("nexus-7c7e9efe-c39f-4953-97de-f8eafd979b1a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17312024-11-22T03:55:09.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17322024-11-22T03:55:09.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17332024-11-22T03:55:09.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17342024-11-22T03:55:09.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17352024-11-22T03:55:09.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17362024-11-22T03:55:09.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17372024-11-22T03:55:09.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3454 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44920 req_id = ab8e1566-2637-4ec5-98c2-cafa14941696 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17382024-11-22T03:55:09.240ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1085
17392024-11-22T03:55:09.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36806
17402024-11-22T03:55:09.528ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2abf54e3-2c6c-44eb-b0e3-3fc421a14a03, kind: Service { id: bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b }, name: Name("external-dns-bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 102])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93f11b6b-2dce-465c-b2b0-dad36b7143b0, kind: Service { id: da108ce4-fade-4cd8-8ba2-9af291527495 }, name: Name("external-dns-da108ce4-fade-4cd8-8ba2-9af291527495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33ae9477-921f-41c3-9ac3-5632e24c2bfe, kind: Service { id: 8af2b85f-6ab3-4781-9033-075825f48255 }, name: Name("nexus-8af2b85f-6ab3-4781-9033-075825f48255"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6f13dd-aee1-4596-bad2-e4f9d9529231, kind: Service { id: da73a142-bb8b-46e7-9b17-ceac40c41577 }, name: Name("nexus-da73a142-bb8b-46e7-9b17-ceac40c41577"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 941af30c-f81b-4662-9f74-f275a9cf5c7d, kind: Service { id: 7c7e9efe-c39f-4953-97de-f8eafd979b1a }, name: Name("nexus-7c7e9efe-c39f-4953-97de-f8eafd979b1a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17412024-11-22T03:55:09.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17422024-11-22T03:55:09.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17432024-11-22T03:55:09.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17442024-11-22T03:55:09.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17452024-11-22T03:55:09.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17462024-11-22T03:55:09.528ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17472024-11-22T03:55:09.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 733 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36806 req_id = 79e69d35-9bb6-473d-855c-0f83f62af52b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17482024-11-22T03:55:09.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48264
17492024-11-22T03:55:09.620ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17502024-11-22T03:55:09.620ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17512024-11-22T03:55:09.620ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-zones.json file = common/src/ledger.rs:178
17522024-11-22T03:55:09.620ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-zones.json file = common/src/ledger.rs:178
17532024-11-22T03:55:09.632ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17542024-11-22T03:55:09.633ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0
17552024-11-22T03:55:09.661ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17562024-11-22T03:55:09.661ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363
17572024-11-22T03:55:09.688ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17582024-11-22T03:55:09.688ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_1182b0f1-244a-4bba-979c-4840fa5a1132
17592024-11-22T03:55:09.714ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17602024-11-22T03:55:09.714ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f
17612024-11-22T03:55:09.737ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17622024-11-22T03:55:09.738ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_157e7505-0f5f-4cc6-9939-e8c05827bf3d
17632024-11-22T03:55:09.762ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17642024-11-22T03:55:09.762ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f13a1c2f-8642-4111-9bab-2dc9809f2e5b
17652024-11-22T03:55:09.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50456
17662024-11-22T03:55:09.779ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2abf54e3-2c6c-44eb-b0e3-3fc421a14a03, kind: Service { id: bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b }, name: Name("external-dns-bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 102])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93f11b6b-2dce-465c-b2b0-dad36b7143b0, kind: Service { id: da108ce4-fade-4cd8-8ba2-9af291527495 }, name: Name("external-dns-da108ce4-fade-4cd8-8ba2-9af291527495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33ae9477-921f-41c3-9ac3-5632e24c2bfe, kind: Service { id: 8af2b85f-6ab3-4781-9033-075825f48255 }, name: Name("nexus-8af2b85f-6ab3-4781-9033-075825f48255"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6f13dd-aee1-4596-bad2-e4f9d9529231, kind: Service { id: da73a142-bb8b-46e7-9b17-ceac40c41577 }, name: Name("nexus-da73a142-bb8b-46e7-9b17-ceac40c41577"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 941af30c-f81b-4662-9f74-f275a9cf5c7d, kind: Service { id: 7c7e9efe-c39f-4953-97de-f8eafd979b1a }, name: Name("nexus-7c7e9efe-c39f-4953-97de-f8eafd979b1a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17672024-11-22T03:55:09.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17682024-11-22T03:55:09.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17692024-11-22T03:55:09.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17702024-11-22T03:55:09.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17712024-11-22T03:55:09.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17722024-11-22T03:55:09.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17732024-11-22T03:55:09.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 875 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50456 req_id = 65e2f456-9964-411c-b2f3-d7aa8b50a224 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17742024-11-22T03:55:09.784ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17752024-11-22T03:55:09.784ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_48b787c2-7c89-4a59-9296-d71ece8b8529
17762024-11-22T03:55:09.804ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17772024-11-22T03:55:09.804ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e4f74c89-1963-417c-814f-cb22f8634b05
17782024-11-22T03:55:09.829ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17792024-11-22T03:55:09.829ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_79b89e7a-03ea-4602-9f51-01fb67551168
17802024-11-22T03:55:09.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222364 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48264 req_id = f62a4a62-7a5a-4915-b575-1a216d57e5ad response_code = 200 uri = /inventory
17812024-11-22T03:55:11.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35640
17822024-11-22T03:55:11.014ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2abf54e3-2c6c-44eb-b0e3-3fc421a14a03, kind: Service { id: bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b }, name: Name("external-dns-bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 102])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93f11b6b-2dce-465c-b2b0-dad36b7143b0, kind: Service { id: da108ce4-fade-4cd8-8ba2-9af291527495 }, name: Name("external-dns-da108ce4-fade-4cd8-8ba2-9af291527495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33ae9477-921f-41c3-9ac3-5632e24c2bfe, kind: Service { id: 8af2b85f-6ab3-4781-9033-075825f48255 }, name: Name("nexus-8af2b85f-6ab3-4781-9033-075825f48255"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6f13dd-aee1-4596-bad2-e4f9d9529231, kind: Service { id: da73a142-bb8b-46e7-9b17-ceac40c41577 }, name: Name("nexus-da73a142-bb8b-46e7-9b17-ceac40c41577"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 941af30c-f81b-4662-9f74-f275a9cf5c7d, kind: Service { id: 7c7e9efe-c39f-4953-97de-f8eafd979b1a }, name: Name("nexus-7c7e9efe-c39f-4953-97de-f8eafd979b1a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17832024-11-22T03:55:11.014ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17842024-11-22T03:55:11.014ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17852024-11-22T03:55:11.014ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17862024-11-22T03:55:11.014ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17872024-11-22T03:55:11.014ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17882024-11-22T03:55:11.014ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17892024-11-22T03:55:11.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35640 req_id = c95ce2a0-f85d-4fc2-9f57-c980c4822b2a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17902024-11-22T03:55:14.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43625
17912024-11-22T03:55:14.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43625 req_id = 1a10fe83-dcb4-4a77-a11d-9bb382405ae3 response_code = 200 uri = /vpc-routes
17922024-11-22T03:55:14.603ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
17932024-11-22T03:55:14.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1367 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43625 req_id = 5e420c50-890a-4472-9a92-be40e7c9549d response_code = 204 uri = /eip-gateways
17942024-11-22T03:55:14.647ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43209
17952024-11-22T03:55:14.648ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43209 req_id = 4b0e7f0a-b1c0-411d-9b1a-c72efefb56f4 response_code = 200 uri = /baseboard
17962024-11-22T03:55:14.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1672 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43625 req_id = d7c38926-1a4c-4674-a17b-c0b12b64d344 response_code = 204 uri = /vpc-routes
17972024-11-22T03:55:25.692ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:57755 remote_addr = [fd00:1122:3344:101::d]:54673 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
17982024-11-22T03:55:25.713ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 18286 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = 65eca813-5042-403f-b2cf-eee37c3cb08e response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
17992024-11-22T03:55:28.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53165
18002024-11-22T03:55:28.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53165 req_id = 086b127f-02a1-4565-b510-45746f9de359 response_code = 200 uri = /vpc-routes
18012024-11-22T03:55:28.512ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
18022024-11-22T03:55:28.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53165 req_id = 21c1f368-2656-49d6-a4f1-1a8b62d4f203 response_code = 204 uri = /eip-gateways
18032024-11-22T03:55:28.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53165 req_id = ae5a2213-c0f7-4e7e-96ce-717141bef2f4 response_code = 204 uri = /vpc-routes
18042024-11-22T03:55:28.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54803
18052024-11-22T03:55:28.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 878 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54803 req_id = ba9247d9-fb92-4560-bdc1-62f4061bb132 response_code = 200 uri = /v2p
18062024-11-22T03:55:28.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63575
18072024-11-22T03:55:28.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63575 req_id = 3cb4f9b0-8a3b-4e73-b5de-b3f2c8491a1c response_code = 200 uri = /vpc-routes
18082024-11-22T03:55:28.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40129
18092024-11-22T03:55:28.736ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18102024-11-22T03:55:28.834ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18112024-11-22T03:55:28.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167890 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40129 req_id = 79ba088c-02de-4794-b7d5-b8a2932ae2d6 response_code = 204 uri = /switch-ports
18122024-11-22T03:55:28.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37838
18132024-11-22T03:55:28.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57626
18142024-11-22T03:55:28.904ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
18152024-11-22T03:55:28.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63575 req_id = eb5a4fbc-ff08-4398-b081-f4dfa0a2dbf1 response_code = 204 uri = /eip-gateways
18162024-11-22T03:55:28.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37838 req_id = 0c5543d6-b946-4f91-aaae-4fc0278a17e2 response_code = 200 uri = /v2p
18172024-11-22T03:55:28.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57626 req_id = 769c06e9-809d-4d66-8544-e34c966d04b3 response_code = 200 uri = /vpc-routes
18182024-11-22T03:55:28.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2877 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40129 req_id = 331ab02a-1917-4c51-9dc5-04e657320297 response_code = 200 uri = /network-bootstore-config
18192024-11-22T03:55:28.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63575 req_id = 56ca674d-7cde-41ab-acff-3203429f2166 response_code = 204 uri = /vpc-routes
18202024-11-22T03:55:28.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56079
18212024-11-22T03:55:28.927ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18222024-11-22T03:55:28.968ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18232024-11-22T03:55:29.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105380 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56079 req_id = db97156d-13fd-4417-8e28-a601a26f7475 response_code = 204 uri = /switch-ports
18242024-11-22T03:55:29.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60815
18252024-11-22T03:55:29.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48332
18262024-11-22T03:55:29.033ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
18272024-11-22T03:55:29.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56079 req_id = 27d66f94-e0a7-4064-97bb-c958886f84a3 response_code = 200 uri = /network-bootstore-config
18282024-11-22T03:55:29.033ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18292024-11-22T03:55:29.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57626 req_id = b1c88f23-80be-4e39-bfa8-9121a7b87753 response_code = 204 uri = /eip-gateways
18302024-11-22T03:55:29.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5062 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48332 req_id = 48302711-cfa2-4ea1-ab65-4f6cb675625d response_code = 200 uri = /v2p
18312024-11-22T03:55:29.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 380 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57626 req_id = 0d03a3bd-6c5b-4ccf-b5f3-7108b68c1a0c response_code = 204 uri = /vpc-routes
18322024-11-22T03:55:29.055ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18332024-11-22T03:55:29.055ZINFOSledAgent (bootstore): Writing ledger to /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-sock-i86pc
18342024-11-22T03:55:29.057ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/cluster/bootstore-network-config.json" peer_id = pc-sock-i86pc
18352024-11-22T03:55:29.057ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-sock-i86pc
18362024-11-22T03:55:29.058ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/8681a912-5859-447f-b29e-3905ed40bd28/cluster/bootstore-network-config.json" peer_id = pc-sock-i86pc
18372024-11-22T03:55:29.058ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
18382024-11-22T03:55:29.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5521 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40129 req_id = 88828182-dbdf-4cd3-88d1-cc5f6c10a6d8 response_code = 204 uri = /network-bootstore-config
18392024-11-22T03:55:29.066ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18402024-11-22T03:55:29.066ZINFOSledAgent (bootstore): Writing ledger to /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-sock-i86pc
18412024-11-22T03:55:29.067ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/cluster/bootstore-network-config.json" peer_id = pc-sock-i86pc
18422024-11-22T03:55:29.067ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-sock-i86pc
18432024-11-22T03:55:29.067ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/8681a912-5859-447f-b29e-3905ed40bd28/cluster/bootstore-network-config.json" peer_id = pc-sock-i86pc
18442024-11-22T03:55:29.067ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
18452024-11-22T03:55:29.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 739 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56079 req_id = 61c54a71-c0fa-4c57-b11d-772508d0eeef response_code = 204 uri = /network-bootstore-config
18462024-11-22T03:55:29.074ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18472024-11-22T03:55:29.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93429 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60815 req_id = 03771166-365e-4816-98bb-54c80a105561 response_code = 204 uri = /switch-ports
18482024-11-22T03:55:29.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60815 req_id = 7b0fc1ce-9867-4516-86da-a127874ff747 response_code = 200 uri = /network-bootstore-config
18492024-11-22T03:55:44.681ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53301
18502024-11-22T03:55:44.681ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53301 req_id = fbc2d991-ca79-4f00-976c-4eb3323da6ec response_code = 200 uri = /baseboard
18512024-11-22T03:55:55.638ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6879 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = 01b5ca1d-cb12-4f8f-be3d-0b02f4caa19e response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
18522024-11-22T03:55:58.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64518
18532024-11-22T03:55:58.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64518 req_id = a4fdb7ef-5254-44a3-93f4-14e07ae35bda response_code = 200 uri = /vpc-routes
18542024-11-22T03:55:58.534ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
18552024-11-22T03:55:58.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64518 req_id = bb283e7b-ab5e-44b8-b9d5-491ff3d5208a response_code = 204 uri = /eip-gateways
18562024-11-22T03:55:58.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64518 req_id = 03e17239-9ad3-4260-829a-3a925e59f396 response_code = 204 uri = /vpc-routes
18572024-11-22T03:55:58.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46572
18582024-11-22T03:55:58.664ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18592024-11-22T03:55:58.723ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18602024-11-22T03:55:58.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150972 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46572 req_id = 54948b7e-cd8b-415b-9c3d-15c5d2b1e54a response_code = 204 uri = /switch-ports
18612024-11-22T03:55:58.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41995
18622024-11-22T03:55:58.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46572 req_id = 25cb6961-563d-480d-a27f-ac13d73ee725 response_code = 200 uri = /network-bootstore-config
18632024-11-22T03:55:58.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41995 req_id = 0263ca3e-55cb-45e7-827b-4eb29c52aae0 response_code = 200 uri = /v2p
18642024-11-22T03:55:58.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53506
18652024-11-22T03:55:58.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53506 req_id = 91b080be-65cc-40dc-9b78-91c68702bbe1 response_code = 200 uri = /vpc-routes
18662024-11-22T03:55:58.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42579
18672024-11-22T03:55:58.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42579 req_id = 0af0a024-f3d6-41ec-a58f-190826229704 response_code = 200 uri = /v2p
18682024-11-22T03:55:58.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61189
18692024-11-22T03:55:58.936ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18702024-11-22T03:55:58.972ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18712024-11-22T03:55:59.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96645 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61189 req_id = 7e121785-1595-4fbd-af17-103ec908eebe response_code = 204 uri = /switch-ports
18722024-11-22T03:55:59.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61189 req_id = 7de8d56a-843d-4b06-ad62-3a44f2310a44 response_code = 200 uri = /network-bootstore-config
18732024-11-22T03:55:59.034ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
18742024-11-22T03:55:59.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53506 req_id = 06e5306a-9d75-41b3-b6b5-4cd7fbcb7692 response_code = 204 uri = /eip-gateways
18752024-11-22T03:55:59.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53506 req_id = 65271384-3590-4e67-8301-b1afc34f6ce3 response_code = 204 uri = /vpc-routes
18762024-11-22T03:55:59.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34600
18772024-11-22T03:55:59.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34600 req_id = 738ab9dc-bd75-4cc8-ae55-d46b0faece84 response_code = 200 uri = /v2p
18782024-11-22T03:55:59.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46679
18792024-11-22T03:55:59.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46679 req_id = 922dd29b-e532-42ae-86f5-8a1e3c0a9da2 response_code = 200 uri = /vpc-routes
18802024-11-22T03:55:59.144ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
18812024-11-22T03:55:59.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46679 req_id = 625894cb-7457-4c7d-b867-cadcdf35f949 response_code = 204 uri = /eip-gateways
18822024-11-22T03:55:59.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46679 req_id = 6c707863-bec3-4eb7-a55c-0e3513fa9b3a response_code = 204 uri = /vpc-routes
18832024-11-22T03:55:59.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48329
18842024-11-22T03:55:59.186ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18852024-11-22T03:55:59.220ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18862024-11-22T03:55:59.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86159 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48329 req_id = ca9b8b19-c9f4-4753-9cff-2f8a9d84990d response_code = 204 uri = /switch-ports
18872024-11-22T03:55:59.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48329 req_id = 4102ad64-1b44-4ed3-b418-e0c36c333164 response_code = 200 uri = /network-bootstore-config
18882024-11-22T03:56:14.716ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65238
18892024-11-22T03:56:14.716ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65238 req_id = 381140e1-71ab-467f-a3e2-19816e0e356c response_code = 200 uri = /baseboard
18902024-11-22T03:56:25.640ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6082 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = c449c455-b03a-4fa1-973f-0588e8c6faab response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
18912024-11-22T03:56:28.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56169
18922024-11-22T03:56:28.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56169 req_id = 428db7ca-e3b9-43f5-aa38-85526e49b60e response_code = 200 uri = /vpc-routes
18932024-11-22T03:56:28.448ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
18942024-11-22T03:56:28.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56169 req_id = f499166b-f2c3-476c-8209-52a5a74650d0 response_code = 204 uri = /eip-gateways
18952024-11-22T03:56:28.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48734
18962024-11-22T03:56:28.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48734 req_id = c1bff805-8b68-4683-b610-e8adc6a4efb3 response_code = 200 uri = /v2p
18972024-11-22T03:56:28.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56169 req_id = df6b2608-fe6d-4a21-b6d0-e94c6264b83c response_code = 204 uri = /vpc-routes
18982024-11-22T03:56:28.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38321
18992024-11-22T03:56:28.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38321 req_id = 024628e8-8af7-44cc-811b-e3cdb672f228 response_code = 200 uri = /vpc-routes
19002024-11-22T03:56:28.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52374
19012024-11-22T03:56:28.696ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19022024-11-22T03:56:28.742ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19032024-11-22T03:56:28.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107001 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52374 req_id = 470f19f0-a4a3-4351-b2d5-76a38a6593fe response_code = 204 uri = /switch-ports
19042024-11-22T03:56:28.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44534
19052024-11-22T03:56:28.803ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
19062024-11-22T03:56:28.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38321 req_id = 70fd9845-be1f-46d7-ae70-3155ebc6bbe2 response_code = 204 uri = /eip-gateways
19072024-11-22T03:56:28.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52374 req_id = 3be71ab2-7e32-47a8-8599-517e7fe478a0 response_code = 200 uri = /network-bootstore-config
19082024-11-22T03:56:28.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44534 req_id = 6b35b98c-6260-4b4f-aa99-b963c365b03c response_code = 200 uri = /v2p
19092024-11-22T03:56:28.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38321 req_id = 0677decb-5bed-4b20-8a8b-afba67e8104b response_code = 204 uri = /vpc-routes
19102024-11-22T03:56:28.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42474
19112024-11-22T03:56:28.903ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19122024-11-22T03:56:28.943ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19132024-11-22T03:56:29.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98827 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42474 req_id = 7812ada3-dcbd-474c-97b2-e35bf1a53f0b response_code = 204 uri = /switch-ports
19142024-11-22T03:56:29.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49387
19152024-11-22T03:56:29.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52597
19162024-11-22T03:56:29.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52597 req_id = 2ebf1ad1-0308-463d-a4d0-17a897f541ce response_code = 200 uri = /v2p
19172024-11-22T03:56:29.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42474 req_id = f1a15a82-5a5e-47ca-9527-5703fcd01ca6 response_code = 200 uri = /network-bootstore-config
19182024-11-22T03:56:29.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49387 req_id = 9e577308-4326-43fa-896a-c79a2a716cc6 response_code = 200 uri = /vpc-routes
19192024-11-22T03:56:29.019ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
19202024-11-22T03:56:29.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49387 req_id = d9698c2a-7514-4b2b-9da5-40847b41d14d response_code = 204 uri = /eip-gateways
19212024-11-22T03:56:29.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48720
19222024-11-22T03:56:29.022ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19232024-11-22T03:56:29.063ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19242024-11-22T03:56:29.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102451 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48720 req_id = 075b9998-b25a-47f2-bf16-a4ccac492e7e response_code = 204 uri = /switch-ports
19252024-11-22T03:56:29.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48720 req_id = eed0199a-f54b-4d29-9ecd-6c4aec3b4c97 response_code = 200 uri = /network-bootstore-config
19262024-11-22T03:56:29.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 510 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49387 req_id = 81949e3c-b516-4ae3-af3a-974338c19081 response_code = 204 uri = /vpc-routes
19272024-11-22T03:56:32.833ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19282024-11-22T03:56:44.750ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48667
19292024-11-22T03:56:44.750ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48667 req_id = c72322b3-03df-4735-bb10-143abe710cde response_code = 200 uri = /baseboard
19302024-11-22T03:56:55.640ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6160 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = 3fce678d-5c9e-4229-9b8c-54ed07272210 response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
19312024-11-22T03:56:58.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45696
19322024-11-22T03:56:58.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45696 req_id = aec4fc90-9588-4471-b2e0-42d6571fa6c4 response_code = 200 uri = /vpc-routes
19332024-11-22T03:56:58.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61830
19342024-11-22T03:56:58.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61830 req_id = 29750b87-1e70-4d9e-9a8e-1ecf26c14711 response_code = 200 uri = /vpc-routes
19352024-11-22T03:56:58.756ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
19362024-11-22T03:56:58.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45696 req_id = e8a6f7c8-a12d-41c1-8a70-d7a09acbd8f4 response_code = 204 uri = /eip-gateways
19372024-11-22T03:56:58.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45696 req_id = 1cf1bf11-1ffd-4598-b1d1-bffc3c92c5cb response_code = 204 uri = /vpc-routes
19382024-11-22T03:56:58.785ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
19392024-11-22T03:56:58.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61830 req_id = 6f4f41ef-ed65-446a-9a6f-343ebfb07a21 response_code = 204 uri = /eip-gateways
19402024-11-22T03:56:58.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61830 req_id = 68670698-8ef5-459b-b713-4de1ca050cd8 response_code = 204 uri = /vpc-routes
19412024-11-22T03:56:58.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45289
19422024-11-22T03:56:58.826ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19432024-11-22T03:56:58.865ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19442024-11-22T03:56:58.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131736 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45289 req_id = dabdf23d-9396-4b22-8414-bb4e4d958405 response_code = 204 uri = /switch-ports
19452024-11-22T03:56:58.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50267
19462024-11-22T03:56:58.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34702
19472024-11-22T03:56:58.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34702 req_id = 5e8dbdbd-0d17-4e52-ab14-63d4643f6d4f response_code = 200 uri = /vpc-routes
19482024-11-22T03:56:58.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45289 req_id = 781e3705-a37a-471c-8260-0d3cdb174374 response_code = 200 uri = /network-bootstore-config
19492024-11-22T03:56:58.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50267 req_id = 44c6b651-d043-41da-8a0b-d0ed896f5542 response_code = 200 uri = /v2p
19502024-11-22T03:56:59.008ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
19512024-11-22T03:56:59.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34702 req_id = 46e21b1b-96d4-4b07-9fe5-39b41855228b response_code = 204 uri = /eip-gateways
19522024-11-22T03:56:59.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34702 req_id = bf5b4178-73cc-4da3-8d61-decb7c7dd76a response_code = 204 uri = /vpc-routes
19532024-11-22T03:56:59.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39039
19542024-11-22T03:56:59.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39039 req_id = e796ce4e-278c-45ed-991f-bb0e4f658b54 response_code = 200 uri = /v2p
19552024-11-22T03:56:59.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64866
19562024-11-22T03:56:59.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64866 req_id = ca0e0c49-4372-4022-a01c-eb4863963023 response_code = 200 uri = /v2p
19572024-11-22T03:56:59.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53295
19582024-11-22T03:56:59.237ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19592024-11-22T03:56:59.274ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19602024-11-22T03:56:59.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90497 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53295 req_id = 438b8e0c-44b0-406b-8a8d-59a3e6776620 response_code = 204 uri = /switch-ports
19612024-11-22T03:56:59.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45917
19622024-11-22T03:56:59.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53295 req_id = 0e8fa1da-c801-4545-8933-f5ce0a5eee71 response_code = 200 uri = /network-bootstore-config
19632024-11-22T03:56:59.328ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19642024-11-22T03:56:59.365ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19652024-11-22T03:56:59.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95905 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45917 req_id = 77cbea28-514e-4c26-9a14-d8144e7b7b82 response_code = 204 uri = /switch-ports
19662024-11-22T03:56:59.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45917 req_id = 9d8d949a-5840-496c-9ccb-68b546f93421 response_code = 200 uri = /network-bootstore-config
19672024-11-22T03:57:14.785ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38370
19682024-11-22T03:57:14.785ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38370 req_id = d3bf7157-ba96-419d-9b42-bc105ff31780 response_code = 200 uri = /baseboard
19692024-11-22T03:57:25.642ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7099 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = ea4f8cf6-3232-4863-ba61-56bbae819016 response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
19702024-11-22T03:57:28.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44960
19712024-11-22T03:57:28.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44960 req_id = 14c21e57-8cee-4bc9-b2ff-d6f36d524e5e response_code = 200 uri = /v2p
19722024-11-22T03:57:28.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61945
19732024-11-22T03:57:28.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61945 req_id = 0e86ece3-031c-460d-8042-2b031a9f7bf1 response_code = 200 uri = /vpc-routes
19742024-11-22T03:57:28.533ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
19752024-11-22T03:57:28.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61945 req_id = fccc7f50-effa-4fc6-a261-54e9d3ae4195 response_code = 204 uri = /eip-gateways
19762024-11-22T03:57:28.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64695
19772024-11-22T03:57:28.563ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19782024-11-22T03:57:28.603ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19792024-11-22T03:57:28.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118902 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64695 req_id = ace9788c-792e-44b8-9f13-59381a436e76 response_code = 204 uri = /switch-ports
19802024-11-22T03:57:28.682ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36597
19812024-11-22T03:57:28.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64695 req_id = 1a5a900e-f5d3-42c7-8441-9e3c6dcf7e9c response_code = 200 uri = /network-bootstore-config
19822024-11-22T03:57:28.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 542 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61945 req_id = 138d46ae-fafe-4f94-a70d-2671d844069b response_code = 204 uri = /vpc-routes
19832024-11-22T03:57:28.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36597 req_id = 29c7538b-a74f-49ee-871f-c622c033b5d0 response_code = 200 uri = /vpc-routes
19842024-11-22T03:57:28.744ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
19852024-11-22T03:57:28.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36597 req_id = 7ca5aea8-279a-4283-bf33-009bd91ad519 response_code = 204 uri = /eip-gateways
19862024-11-22T03:57:28.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53346
19872024-11-22T03:57:28.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53346 req_id = 89601157-aecc-4b0a-8aee-2d213ca69393 response_code = 200 uri = /v2p
19882024-11-22T03:57:28.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36597 req_id = 41d70c6a-d245-4825-a106-7e0861b8363c response_code = 204 uri = /vpc-routes
19892024-11-22T03:57:28.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59543
19902024-11-22T03:57:28.818ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19912024-11-22T03:57:28.856ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19922024-11-22T03:57:28.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92862 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59543 req_id = 6887dfb5-0ba3-49d3-ab8a-5f803ba29ca8 response_code = 204 uri = /switch-ports
19932024-11-22T03:57:28.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52996
19942024-11-22T03:57:28.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52996 req_id = 9381b725-8ca4-4e15-bf23-c069fe8fe737 response_code = 200 uri = /vpc-routes
19952024-11-22T03:57:28.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59543 req_id = bb277004-8b68-4ca5-93bf-ba7b7affa47e response_code = 200 uri = /network-bootstore-config
19962024-11-22T03:57:28.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36367
19972024-11-22T03:57:28.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36367 req_id = 0cd29809-7320-481a-988f-a8f8ab5a4918 response_code = 200 uri = /v2p
19982024-11-22T03:57:28.935ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
19992024-11-22T03:57:28.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52996 req_id = 59e28184-c916-4074-817b-d3651b1ccc69 response_code = 204 uri = /eip-gateways
20002024-11-22T03:57:29.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52996 req_id = 38ea5dbb-5a55-42e9-9349-55acda38f627 response_code = 204 uri = /vpc-routes
20012024-11-22T03:57:29.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44123
20022024-11-22T03:57:29.158ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20032024-11-22T03:57:29.193ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20042024-11-22T03:57:29.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87265 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44123 req_id = e115addd-b23f-4fc3-b40c-9b4214bb7b92 response_code = 204 uri = /switch-ports
20052024-11-22T03:57:29.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44123 req_id = 61402ee6-a3bc-491e-9b5a-13deec7954d5 response_code = 200 uri = /network-bootstore-config
20062024-11-22T03:57:44.820ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33910
20072024-11-22T03:57:44.820ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33910 req_id = e64850e5-355d-4134-924d-c7d7dabe5937 response_code = 200 uri = /baseboard
20082024-11-22T03:57:55.642ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7028 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = c3c9e44c-4cf3-476e-997c-32d520ceb98b response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
20092024-11-22T03:57:58.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37171
20102024-11-22T03:57:58.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37171 req_id = ec3ef147-f6dc-4074-8806-06390221463f response_code = 200 uri = /vpc-routes
20112024-11-22T03:57:58.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36333
20122024-11-22T03:57:58.736ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20132024-11-22T03:57:58.780ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20142024-11-22T03:57:58.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112177 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36333 req_id = 0496cabf-8274-44ed-9b26-713b5e8b5252 response_code = 204 uri = /switch-ports
20152024-11-22T03:57:58.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35779
20162024-11-22T03:57:58.849ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
20172024-11-22T03:57:58.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37171 req_id = 4f8307c1-3e70-4424-9c59-fe3307db4a30 response_code = 204 uri = /eip-gateways
20182024-11-22T03:57:58.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36333 req_id = 5eff742e-a092-49f1-b7eb-2e9de957269c response_code = 200 uri = /network-bootstore-config
20192024-11-22T03:57:58.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35779 req_id = 33f6040c-f381-4495-9ed8-ba24a20b3e22 response_code = 200 uri = /v2p
20202024-11-22T03:57:58.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37171 req_id = 3e06b38f-1818-4d80-9a78-1309242bc22d response_code = 204 uri = /vpc-routes
20212024-11-22T03:57:59.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40209
20222024-11-22T03:57:59.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40209 req_id = c581386b-bab0-4bf3-b8c8-f9bb7457b1de response_code = 200 uri = /vpc-routes
20232024-11-22T03:57:59.083ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
20242024-11-22T03:57:59.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40209 req_id = b5cebd9a-77e4-4355-b384-c45fa8541780 response_code = 204 uri = /eip-gateways
20252024-11-22T03:57:59.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37571
20262024-11-22T03:57:59.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37571 req_id = 8018bf1b-27ff-4a23-9a6c-a7247286ba89 response_code = 200 uri = /vpc-routes
20272024-11-22T03:57:59.165ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
20282024-11-22T03:57:59.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37571 req_id = f5905c64-32c9-4c5b-916a-8ec1f3091efb response_code = 204 uri = /eip-gateways
20292024-11-22T03:57:59.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37571 req_id = 3f379876-d4a0-4681-8ba5-707f4397047c response_code = 204 uri = /vpc-routes
20302024-11-22T03:57:59.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58928
20312024-11-22T03:57:59.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58928 req_id = f3f9bc6a-3424-45f2-a8b9-a21350f4624f response_code = 200 uri = /v2p
20322024-11-22T03:57:59.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40209 req_id = fdf834c7-555f-451d-8082-1c58cfdba03b response_code = 204 uri = /vpc-routes
20332024-11-22T03:57:59.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55328
20342024-11-22T03:57:59.209ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20352024-11-22T03:57:59.246ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20362024-11-22T03:57:59.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89278 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55328 req_id = 39504caa-87a9-420f-870d-dca034db2c53 response_code = 204 uri = /switch-ports
20372024-11-22T03:57:59.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44995
20382024-11-22T03:57:59.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44995 req_id = 6a3eb144-9191-483b-89a5-92dedc2ba3db response_code = 200 uri = /v2p
20392024-11-22T03:57:59.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55328 req_id = b688594a-a3c7-4f54-bdc1-d6dfbf2c9ddb response_code = 200 uri = /network-bootstore-config
20402024-11-22T03:57:59.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60741
20412024-11-22T03:57:59.328ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20422024-11-22T03:57:59.362ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20432024-11-22T03:57:59.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83104 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60741 req_id = 8f1895ed-1c32-402b-b27b-eaad1dafba96 response_code = 204 uri = /switch-ports
20442024-11-22T03:57:59.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60741 req_id = 04c03c27-5d53-49d4-b75d-0bea4b368038 response_code = 200 uri = /network-bootstore-config
20452024-11-22T03:58:14.855ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35856
20462024-11-22T03:58:14.855ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35856 req_id = 6742927d-01d7-4fef-94a3-5e077dfd0bc6 response_code = 200 uri = /baseboard
20472024-11-22T03:58:25.644ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7450 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = 15972adb-af02-499c-86dd-71d299a8f212 response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
20482024-11-22T03:58:28.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44532
20492024-11-22T03:58:28.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44532 req_id = dbf101b2-ba6e-4b2d-8c7c-8dff7ed58f1a response_code = 200 uri = /vpc-routes
20502024-11-22T03:58:28.681ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
20512024-11-22T03:58:28.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44532 req_id = 4ddcbb46-95b1-4766-8b27-0b8ac5123d35 response_code = 204 uri = /eip-gateways
20522024-11-22T03:58:28.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44532 req_id = dcc1e8dd-f1f7-41e8-ad13-094709c69d4f response_code = 204 uri = /vpc-routes
20532024-11-22T03:58:28.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52578
20542024-11-22T03:58:28.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52578 req_id = 4657a1ea-f6f5-4392-a23a-d9c31fc8f83a response_code = 200 uri = /vpc-routes
20552024-11-22T03:58:28.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34909
20562024-11-22T03:58:28.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34909 req_id = 69ed7193-89ed-425d-8cbc-aae161bc7973 response_code = 200 uri = /vpc-routes
20572024-11-22T03:58:28.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60526
20582024-11-22T03:58:28.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60526 req_id = d509def5-f028-4244-b6ee-a889c3bf9b6e response_code = 200 uri = /v2p
20592024-11-22T03:58:28.798ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
20602024-11-22T03:58:28.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52578 req_id = 7b444141-8d88-45b9-b44a-3330ab410c92 response_code = 204 uri = /eip-gateways
20612024-11-22T03:58:28.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52578 req_id = 204c189d-aa12-489d-9be4-1ad850e5c73f response_code = 204 uri = /vpc-routes
20622024-11-22T03:58:28.838ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
20632024-11-22T03:58:28.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34909 req_id = 371d5569-0b01-4bc6-b720-4647f645b4c1 response_code = 204 uri = /eip-gateways
20642024-11-22T03:58:28.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58533
20652024-11-22T03:58:28.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58533 req_id = 027b5bcd-0a02-4ed6-a9ce-856b49967d42 response_code = 200 uri = /v2p
20662024-11-22T03:58:28.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34909 req_id = e5fc2a3a-5862-46ec-a6d2-c783e4b63471 response_code = 204 uri = /vpc-routes
20672024-11-22T03:58:28.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51168
20682024-11-22T03:58:28.888ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20692024-11-22T03:58:28.927ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20702024-11-22T03:58:28.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91347 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51168 req_id = a8a9c45f-ef68-454d-98ab-20fc6485bfc0 response_code = 204 uri = /switch-ports
20712024-11-22T03:58:28.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46731
20722024-11-22T03:58:28.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46731 req_id = 6f54aeeb-e70e-489f-be5e-f2344e2bac58 response_code = 200 uri = /v2p
20732024-11-22T03:58:28.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51168 req_id = a8bfbba0-da7e-4b7d-a1fc-b9507b231ad4 response_code = 200 uri = /network-bootstore-config
20742024-11-22T03:58:29.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34494
20752024-11-22T03:58:29.115ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20762024-11-22T03:58:29.149ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20772024-11-22T03:58:29.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89509 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34494 req_id = ba959571-3120-4943-857c-18e938fed4f9 response_code = 204 uri = /switch-ports
20782024-11-22T03:58:29.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34494 req_id = 66652fad-4a0e-4bbb-8912-95ebd5dca982 response_code = 200 uri = /network-bootstore-config
20792024-11-22T03:58:29.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42139
20802024-11-22T03:58:29.326ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20812024-11-22T03:58:29.365ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20822024-11-22T03:58:29.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98188 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42139 req_id = a382a105-fb41-4294-aefe-f05ae470a737 response_code = 204 uri = /switch-ports
20832024-11-22T03:58:29.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42139 req_id = 21c5baf7-6854-4724-98b7-ef2062ef60a8 response_code = 200 uri = /network-bootstore-config
20842024-11-22T03:58:44.888ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41735
20852024-11-22T03:58:44.888ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41735 req_id = d05c5686-6a4b-4075-82d7-3b7231b4f1ae response_code = 200 uri = /baseboard
20862024-11-22T03:58:55.644ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6815 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = 0b705131-5279-47e3-94ec-54b55ec4508c response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
20872024-11-22T03:58:58.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42743
20882024-11-22T03:58:58.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42743 req_id = 91970c91-d2c0-4bb7-880e-6feceaf1d82a response_code = 200 uri = /vpc-routes
20892024-11-22T03:58:58.638ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
20902024-11-22T03:58:58.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42743 req_id = 1d3150a3-8261-4f47-a6a9-cc1d09099668 response_code = 204 uri = /eip-gateways
20912024-11-22T03:58:58.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42743 req_id = 52e3c374-4d42-4203-b0a3-4bd8fadc8052 response_code = 204 uri = /vpc-routes
20922024-11-22T03:58:58.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63020
20932024-11-22T03:58:58.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63020 req_id = ff439c43-9d56-4951-b5af-ddf31d3fa2c1 response_code = 200 uri = /vpc-routes
20942024-11-22T03:58:58.740ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
20952024-11-22T03:58:58.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63020 req_id = debca495-209d-4b90-adbb-69f6c03be1b8 response_code = 204 uri = /eip-gateways
20962024-11-22T03:58:58.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63020 req_id = cc6a8688-f2a7-44c5-99b1-091d37971783 response_code = 204 uri = /vpc-routes
20972024-11-22T03:58:58.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37639
20982024-11-22T03:58:58.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37639 req_id = a804ceea-de9a-4e99-b3e3-cd6b9c634801 response_code = 200 uri = /v2p
20992024-11-22T03:58:58.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48975
21002024-11-22T03:58:58.833ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21012024-11-22T03:58:58.874ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21022024-11-22T03:58:58.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116534 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48975 req_id = 409fbe97-39c7-4ee8-9e0b-20d4fd6f5ef0 response_code = 204 uri = /switch-ports
21032024-11-22T03:58:58.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59615
21042024-11-22T03:58:58.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59615 req_id = bb29eead-e5a0-4a52-af3d-4f60ed43a21f response_code = 200 uri = /vpc-routes
21052024-11-22T03:58:58.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48975 req_id = 46dd0c79-065f-434a-bf56-49fec178d5ba response_code = 200 uri = /network-bootstore-config
21062024-11-22T03:58:59.001ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
21072024-11-22T03:58:59.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59615 req_id = b6879937-4235-46c6-b692-0e525ffebf61 response_code = 204 uri = /eip-gateways
21082024-11-22T03:58:59.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59615 req_id = 4b3cc9a9-23cc-4bfb-a63d-53b9f2a352ac response_code = 204 uri = /vpc-routes
21092024-11-22T03:58:59.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37112
21102024-11-22T03:58:59.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37112 req_id = dc6153f1-760e-472a-8549-ca645e6c5d13 response_code = 200 uri = /v2p
21112024-11-22T03:58:59.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55318
21122024-11-22T03:58:59.070ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21132024-11-22T03:58:59.105ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21142024-11-22T03:58:59.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83283 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55318 req_id = 2d931e5e-de8a-4249-ae74-61e66b55ca5b response_code = 204 uri = /switch-ports
21152024-11-22T03:58:59.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34767
21162024-11-22T03:58:59.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37707
21172024-11-22T03:58:59.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55318 req_id = ae26a751-c050-43e6-8e22-b8aa7c964c9f response_code = 200 uri = /network-bootstore-config
21182024-11-22T03:58:59.154ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21192024-11-22T03:58:59.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5582 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34767 req_id = 9f6bd797-4784-4ef4-b750-6f092c49a0f1 response_code = 200 uri = /v2p
21202024-11-22T03:58:59.188ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21212024-11-22T03:58:59.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87088 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37707 req_id = f9aaf56b-6231-45ba-a9d8-f0cb87a0f60c response_code = 204 uri = /switch-ports
21222024-11-22T03:58:59.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37707 req_id = 3653bb3e-9bda-4894-aae1-16afd7afa0a8 response_code = 200 uri = /network-bootstore-config
21232024-11-22T03:59:14.922ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64630
21242024-11-22T03:59:14.922ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64630 req_id = c900d4f7-a75c-43a2-90a9-7cbdd4e77c46 response_code = 200 uri = /baseboard
21252024-11-22T03:59:25.640ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7003 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = 226a9aeb-ba61-4d85-9189-dbd06e894a8a response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
21262024-11-22T03:59:28.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50613
21272024-11-22T03:59:28.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50613 req_id = c130a44d-80da-4f2d-8ff9-65cc0924e150 response_code = 200 uri = /vpc-routes
21282024-11-22T03:59:28.482ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
21292024-11-22T03:59:28.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50613 req_id = 54212921-8730-4cd0-bcab-859546880981 response_code = 204 uri = /eip-gateways
21302024-11-22T03:59:28.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50613 req_id = a1d9b5e0-cb60-4607-811a-168100dac5ec response_code = 204 uri = /vpc-routes
21312024-11-22T03:59:28.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52491
21322024-11-22T03:59:28.499ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21332024-11-22T03:59:28.540ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21342024-11-22T03:59:28.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100329 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52491 req_id = dce64a9a-9f22-43d2-a73b-354f45b96613 response_code = 204 uri = /switch-ports
21352024-11-22T03:59:28.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48837
21362024-11-22T03:59:28.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48837 req_id = dfc39ea5-a945-4694-a0d9-550168810123 response_code = 200 uri = /v2p
21372024-11-22T03:59:28.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52491 req_id = 3ffbd7eb-db6a-46ea-9ca6-cde96afa23cc response_code = 200 uri = /network-bootstore-config
21382024-11-22T03:59:28.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62506
21392024-11-22T03:59:28.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62506 req_id = dbb299cd-adc0-433d-957a-5637407358bf response_code = 200 uri = /vpc-routes
21402024-11-22T03:59:28.809ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
21412024-11-22T03:59:28.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62506 req_id = b2e86645-49b9-411f-9940-2aef732dd41a response_code = 204 uri = /eip-gateways
21422024-11-22T03:59:28.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 373 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62506 req_id = 2601c630-e9a2-42db-b98f-d8700abefef1 response_code = 204 uri = /vpc-routes
21432024-11-22T03:59:28.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48145
21442024-11-22T03:59:28.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48145 req_id = 4f754d17-6b78-4b54-bc42-d0f980d5d9bd response_code = 200 uri = /vpc-routes
21452024-11-22T03:59:28.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48853
21462024-11-22T03:59:28.833ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21472024-11-22T03:59:28.872ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21482024-11-22T03:59:28.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103983 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48853 req_id = 87958e31-aa69-4003-8b55-367966bc310b response_code = 204 uri = /switch-ports
21492024-11-22T03:59:28.937ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
21502024-11-22T03:59:28.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48145 req_id = 5b4effe2-ecb4-4386-92a2-69dc9fcd4526 response_code = 204 uri = /eip-gateways
21512024-11-22T03:59:28.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48853 req_id = c1731f4c-502d-4e89-9aa3-f75725785a24 response_code = 200 uri = /network-bootstore-config
21522024-11-22T03:59:28.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48145 req_id = 2fd269fc-62bd-429f-902a-b7eeaf79bc29 response_code = 204 uri = /vpc-routes
21532024-11-22T03:59:28.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51735
21542024-11-22T03:59:28.978ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21552024-11-22T03:59:29.019ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21562024-11-22T03:59:29.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95568 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51735 req_id = fb4e484f-1a6c-47e1-9161-47dbae28f691 response_code = 204 uri = /switch-ports
21572024-11-22T03:59:29.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39091
21582024-11-22T03:59:29.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36912
21592024-11-22T03:59:29.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39091 req_id = 07c06a71-c346-4931-8a0b-6cd44e0ac894 response_code = 200 uri = /v2p
21602024-11-22T03:59:29.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 369 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51735 req_id = 0ac2057b-3523-4ef6-a590-761ce49be857 response_code = 200 uri = /network-bootstore-config
21612024-11-22T03:59:29.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36912 req_id = ef7e8635-1f14-4a43-8ec6-b9a6b7d95fa8 response_code = 200 uri = /v2p
21622024-11-22T03:59:44.953ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37238
21632024-11-22T03:59:44.953ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37238 req_id = ed0147e6-d1a1-4ad1-a1e4-83eb1179af24 response_code = 200 uri = /baseboard
21642024-11-22T03:59:55.639ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6095 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = 63b3655a-f5b3-4bf8-9367-f280aa981985 response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
21652024-11-22T03:59:58.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56103
21662024-11-22T03:59:58.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56103 req_id = b90af8cc-c7ad-4ce6-ac63-8c1e0460af9b response_code = 200 uri = /vpc-routes
21672024-11-22T03:59:58.605ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
21682024-11-22T03:59:58.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56103 req_id = 9cd3e942-9785-4e96-8031-af1a26b7c087 response_code = 204 uri = /eip-gateways
21692024-11-22T03:59:58.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47385
21702024-11-22T03:59:58.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47385 req_id = 1c5ce90b-2559-436c-9b2d-a270d21c3f5e response_code = 200 uri = /v2p
21712024-11-22T03:59:58.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56103 req_id = 840d1077-7d08-41f5-832e-a23a75eca536 response_code = 204 uri = /vpc-routes
21722024-11-22T03:59:58.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47911
21732024-11-22T03:59:58.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47911 req_id = 20747468-fd8f-4acf-a74c-633b45b1c3a1 response_code = 200 uri = /vpc-routes
21742024-11-22T03:59:58.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58728
21752024-11-22T03:59:58.863ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21762024-11-22T03:59:58.905ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21772024-11-22T03:59:58.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102195 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58728 req_id = 7354f254-9a3b-4551-88ab-8b9a79e4fcd8 response_code = 204 uri = /switch-ports
21782024-11-22T03:59:58.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65404
21792024-11-22T03:59:58.965ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
21802024-11-22T03:59:58.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47911 req_id = eb1891ea-3bdb-46f0-a54a-e1b08e2bfa68 response_code = 204 uri = /eip-gateways
21812024-11-22T03:59:58.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58728 req_id = 83ec46a8-6932-4197-a165-2978ec95a6da response_code = 200 uri = /network-bootstore-config
21822024-11-22T03:59:58.966ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2abf54e3-2c6c-44eb-b0e3-3fc421a14a03, kind: Service { id: bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b }, name: Name("external-dns-bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 102])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93f11b6b-2dce-465c-b2b0-dad36b7143b0, kind: Service { id: da108ce4-fade-4cd8-8ba2-9af291527495 }, name: Name("external-dns-da108ce4-fade-4cd8-8ba2-9af291527495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33ae9477-921f-41c3-9ac3-5632e24c2bfe, kind: Service { id: 8af2b85f-6ab3-4781-9033-075825f48255 }, name: Name("nexus-8af2b85f-6ab3-4781-9033-075825f48255"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6f13dd-aee1-4596-bad2-e4f9d9529231, kind: Service { id: da73a142-bb8b-46e7-9b17-ceac40c41577 }, name: Name("nexus-da73a142-bb8b-46e7-9b17-ceac40c41577"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 941af30c-f81b-4662-9f74-f275a9cf5c7d, kind: Service { id: 7c7e9efe-c39f-4953-97de-f8eafd979b1a }, name: Name("nexus-7c7e9efe-c39f-4953-97de-f8eafd979b1a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21832024-11-22T03:59:58.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21842024-11-22T03:59:58.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21852024-11-22T03:59:58.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
21862024-11-22T03:59:58.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21872024-11-22T03:59:58.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21882024-11-22T03:59:58.966ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21892024-11-22T03:59:58.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 575 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65404 req_id = 25c6d636-68a8-4bc3-b1f5-09ded967faa8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21902024-11-22T03:59:58.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58563
21912024-11-22T03:59:58.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58563 req_id = b770df42-6841-4eea-9bef-39ed77d020e3 response_code = 200 uri = /vpc-routes
21922024-11-22T03:59:58.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47911 req_id = 1c81cc03-6ff0-4a86-8055-5cf1f7585c5d response_code = 204 uri = /vpc-routes
21932024-11-22T03:59:59.020ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
21942024-11-22T03:59:59.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58563 req_id = a0e003f9-f172-4f1c-83da-0319791820be response_code = 204 uri = /eip-gateways
21952024-11-22T03:59:59.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58563 req_id = 8426a8af-2153-4532-8ed4-a875a0377ea0 response_code = 204 uri = /vpc-routes
21962024-11-22T03:59:59.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64079
21972024-11-22T03:59:59.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64079 req_id = 594f8753-6bfe-4571-b136-44fda69bdf2a response_code = 200 uri = /v2p
21982024-11-22T03:59:59.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42533
21992024-11-22T03:59:59.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42533 req_id = 784dcab3-1f98-4a44-8d76-089480c76291 response_code = 200 uri = /v2p
22002024-11-22T03:59:59.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62515
22012024-11-22T03:59:59.147ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22022024-11-22T03:59:59.188ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22032024-11-22T03:59:59.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100948 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62515 req_id = 6c5ad09a-7af1-4fe2-8435-5b91b202c721 response_code = 204 uri = /switch-ports
22042024-11-22T03:59:59.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63238
22052024-11-22T03:59:59.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38080
22062024-11-22T03:59:59.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62515 req_id = 902e9a33-8376-49aa-8e30-55a5e8fc2f84 response_code = 200 uri = /network-bootstore-config
22072024-11-22T03:59:59.248ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22082024-11-22T03:59:59.248ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2abf54e3-2c6c-44eb-b0e3-3fc421a14a03, kind: Service { id: bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b }, name: Name("external-dns-bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 102])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93f11b6b-2dce-465c-b2b0-dad36b7143b0, kind: Service { id: da108ce4-fade-4cd8-8ba2-9af291527495 }, name: Name("external-dns-da108ce4-fade-4cd8-8ba2-9af291527495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33ae9477-921f-41c3-9ac3-5632e24c2bfe, kind: Service { id: 8af2b85f-6ab3-4781-9033-075825f48255 }, name: Name("nexus-8af2b85f-6ab3-4781-9033-075825f48255"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6f13dd-aee1-4596-bad2-e4f9d9529231, kind: Service { id: da73a142-bb8b-46e7-9b17-ceac40c41577 }, name: Name("nexus-da73a142-bb8b-46e7-9b17-ceac40c41577"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 941af30c-f81b-4662-9f74-f275a9cf5c7d, kind: Service { id: 7c7e9efe-c39f-4953-97de-f8eafd979b1a }, name: Name("nexus-7c7e9efe-c39f-4953-97de-f8eafd979b1a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22092024-11-22T03:59:59.249ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22102024-11-22T03:59:59.254ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22112024-11-22T03:59:59.254ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
22122024-11-22T03:59:59.254ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22132024-11-22T03:59:59.254ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22142024-11-22T03:59:59.255ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22152024-11-22T03:59:59.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6728 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38080 req_id = e347dde2-029f-4b5f-8885-e5e4574424dc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22162024-11-22T03:59:59.291ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22172024-11-22T03:59:59.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101124 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63238 req_id = 27fdcc84-2e62-4d90-a730-9b2b7e06bfa2 response_code = 204 uri = /switch-ports
22182024-11-22T03:59:59.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63238 req_id = e96c1ef5-fedc-4c2a-aa2a-666ec0de504b response_code = 200 uri = /network-bootstore-config
22192024-11-22T03:59:59.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40246
22202024-11-22T03:59:59.401ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2abf54e3-2c6c-44eb-b0e3-3fc421a14a03, kind: Service { id: bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b }, name: Name("external-dns-bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 102])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93f11b6b-2dce-465c-b2b0-dad36b7143b0, kind: Service { id: da108ce4-fade-4cd8-8ba2-9af291527495 }, name: Name("external-dns-da108ce4-fade-4cd8-8ba2-9af291527495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33ae9477-921f-41c3-9ac3-5632e24c2bfe, kind: Service { id: 8af2b85f-6ab3-4781-9033-075825f48255 }, name: Name("nexus-8af2b85f-6ab3-4781-9033-075825f48255"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6f13dd-aee1-4596-bad2-e4f9d9529231, kind: Service { id: da73a142-bb8b-46e7-9b17-ceac40c41577 }, name: Name("nexus-da73a142-bb8b-46e7-9b17-ceac40c41577"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 941af30c-f81b-4662-9f74-f275a9cf5c7d, kind: Service { id: 7c7e9efe-c39f-4953-97de-f8eafd979b1a }, name: Name("nexus-7c7e9efe-c39f-4953-97de-f8eafd979b1a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22212024-11-22T03:59:59.401ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22222024-11-22T03:59:59.401ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22232024-11-22T03:59:59.401ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
22242024-11-22T03:59:59.401ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22252024-11-22T03:59:59.401ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22262024-11-22T03:59:59.401ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22272024-11-22T03:59:59.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 429 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40246 req_id = b575145b-3437-41ab-9845-78b2b7d18e4a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22282024-11-22T04:00:14.986ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49174
22292024-11-22T04:00:14.986ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49174 req_id = 9e4b17f3-71c3-4f09-9886-cb914c1601b6 response_code = 200 uri = /baseboard
22302024-11-22T04:00:25.639ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6125 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = f3c52d2c-b364-442f-b083-630def7f300d response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
22312024-11-22T04:00:28.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32807
22322024-11-22T04:00:28.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32807 req_id = 577cfa95-61fa-4038-9cc2-12c76102956a response_code = 200 uri = /vpc-routes
22332024-11-22T04:00:28.436ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
22342024-11-22T04:00:28.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32807 req_id = c2f9da81-962e-4361-a748-db7c16ad452f response_code = 204 uri = /eip-gateways
22352024-11-22T04:00:28.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36192
22362024-11-22T04:00:28.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36192 req_id = 77acac10-6883-4ed1-82f3-099ba40798c8 response_code = 200 uri = /v2p
22372024-11-22T04:00:28.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32807 req_id = c6e59e2d-d3f9-4cca-b5a1-997405002a08 response_code = 204 uri = /vpc-routes
22382024-11-22T04:00:28.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39507
22392024-11-22T04:00:28.530ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22402024-11-22T04:00:28.570ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22412024-11-22T04:00:28.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99568 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39507 req_id = 28a74f21-5445-40b6-b805-61cb825aca5e response_code = 204 uri = /switch-ports
22422024-11-22T04:00:28.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39507 req_id = cd7d53da-a119-4087-af9e-d515e13f7bb7 response_code = 200 uri = /network-bootstore-config
22432024-11-22T04:00:28.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62105
22442024-11-22T04:00:28.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62105 req_id = bab5ba77-6f31-40a4-a266-cf40d52ed5af response_code = 200 uri = /vpc-routes
22452024-11-22T04:00:28.706ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
22462024-11-22T04:00:28.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62105 req_id = fa27d49b-1677-45eb-b719-9331327cb062 response_code = 204 uri = /eip-gateways
22472024-11-22T04:00:28.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 416 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62105 req_id = 212452be-dc49-452d-b64c-c048e8eec8af response_code = 204 uri = /vpc-routes
22482024-11-22T04:00:28.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53388
22492024-11-22T04:00:28.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53388 req_id = e280b0ee-cf4b-44ec-9101-af85fa30a441 response_code = 200 uri = /v2p
22502024-11-22T04:00:28.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61738
22512024-11-22T04:00:28.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61738 req_id = 624da6fd-027c-4330-8090-db87a6a6b3b3 response_code = 200 uri = /vpc-routes
22522024-11-22T04:00:28.876ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
22532024-11-22T04:00:28.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61738 req_id = df3d18f3-80aa-49e9-9a2a-af911e6e3bef response_code = 204 uri = /eip-gateways
22542024-11-22T04:00:28.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48001
22552024-11-22T04:00:28.878ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22562024-11-22T04:00:28.918ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22572024-11-22T04:00:28.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93299 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48001 req_id = f5a7bcbf-dc5b-4fc4-9317-7cd21703afcf response_code = 204 uri = /switch-ports
22582024-11-22T04:00:28.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44530
22592024-11-22T04:00:28.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36878
22602024-11-22T04:00:28.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48001 req_id = 41d6f5d5-55c5-4fba-a92c-58ce65bd5a04 response_code = 200 uri = /network-bootstore-config
22612024-11-22T04:00:28.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61738 req_id = 6977608a-7573-41ee-853a-9ecfc2f20668 response_code = 204 uri = /vpc-routes
22622024-11-22T04:00:28.972ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22632024-11-22T04:00:28.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3817 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36878 req_id = 2df47f3f-cb63-4a52-80bd-2a7cf1290211 response_code = 200 uri = /v2p
22642024-11-22T04:00:29.010ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22652024-11-22T04:00:29.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98107 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44530 req_id = 227e0829-f131-4714-a720-9bcd58834736 response_code = 204 uri = /switch-ports
22662024-11-22T04:00:29.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44530 req_id = eb4b4125-d981-466e-8189-5f2eaae277f9 response_code = 200 uri = /network-bootstore-config
22672024-11-22T04:00:45.020ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35040
22682024-11-22T04:00:45.020ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35040 req_id = e0ae10f7-118d-4b67-b3c8-4cbfd86964ea response_code = 200 uri = /baseboard
22692024-11-22T04:00:55.638ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5527 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = f50ca36a-8fa6-4465-ba73-7ab71d5a4298 response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
22702024-11-22T04:00:58.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52185
22712024-11-22T04:00:58.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52185 req_id = ee2116e9-e16c-4872-994c-3e571576e9ff response_code = 200 uri = /v2p
22722024-11-22T04:00:58.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45183
22732024-11-22T04:00:58.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45183 req_id = 1f79df60-207d-4550-b72a-9100a42643b8 response_code = 200 uri = /vpc-routes
22742024-11-22T04:00:58.567ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
22752024-11-22T04:00:58.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45183 req_id = 7cc4faa6-ba8a-46d7-89f0-9c7f2a32e9c6 response_code = 204 uri = /eip-gateways
22762024-11-22T04:00:58.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45183 req_id = b4407b54-ff07-46ba-be07-3f57ec8097c3 response_code = 204 uri = /vpc-routes
22772024-11-22T04:00:58.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46000
22782024-11-22T04:00:58.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46000 req_id = 72cde1d3-d987-4010-95d3-acd156f1cee7 response_code = 200 uri = /vpc-routes
22792024-11-22T04:00:58.744ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
22802024-11-22T04:00:58.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46000 req_id = 53522456-2e4d-4a03-a6e4-60b40d9dc8f0 response_code = 204 uri = /eip-gateways
22812024-11-22T04:00:58.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46000 req_id = 14aa24b4-aeac-4996-9614-ac3d80aea379 response_code = 204 uri = /vpc-routes
22822024-11-22T04:00:58.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54743
22832024-11-22T04:00:58.882ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22842024-11-22T04:00:58.916ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22852024-11-22T04:00:58.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93023 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54743 req_id = 058557e0-04d0-4a7d-9acd-b749a4a2ba6f response_code = 204 uri = /switch-ports
22862024-11-22T04:00:58.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62579
22872024-11-22T04:00:58.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47006
22882024-11-22T04:00:58.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47394
22892024-11-22T04:00:58.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64189
22902024-11-22T04:00:58.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64189 req_id = f69b570e-46b4-429e-a476-00d96ed2e40c response_code = 200 uri = /v2p
22912024-11-22T04:00:58.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47394 req_id = 2c259915-395d-4c09-88f2-89cbb1fac91d response_code = 200 uri = /vpc-routes
22922024-11-22T04:00:58.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62579 req_id = 3f0fe2f4-ed8f-4456-ab3a-a5aec13e1e60 response_code = 200 uri = /v2p
22932024-11-22T04:00:58.975ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22942024-11-22T04:00:58.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 349 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54743 req_id = f9abcc0f-7efa-4218-8b05-63308adbe987 response_code = 200 uri = /network-bootstore-config
22952024-11-22T04:00:58.998ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
22962024-11-22T04:00:58.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47394 req_id = 59b9a7e3-a27a-42b0-aac8-4c7c9f66fa51 response_code = 204 uri = /eip-gateways
22972024-11-22T04:00:59.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47394 req_id = 471d89ec-3c1f-4b21-9169-c677d784b1a7 response_code = 204 uri = /vpc-routes
22982024-11-22T04:00:59.019ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22992024-11-22T04:00:59.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44421
23002024-11-22T04:00:59.079ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23012024-11-22T04:00:59.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103745 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47006 req_id = a41dae2b-d032-4af6-8e3f-ef681ac52796 response_code = 204 uri = /switch-ports
23022024-11-22T04:00:59.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 719 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47006 req_id = 436a5ccb-0523-4d9f-bac6-98ea3bad748c response_code = 200 uri = /network-bootstore-config
23032024-11-22T04:00:59.115ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23042024-11-22T04:00:59.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119884 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44421 req_id = deac6748-0d72-43e5-bb64-4b7db9d12e05 response_code = 204 uri = /switch-ports
23052024-11-22T04:00:59.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44421 req_id = eb29cbc2-4037-419b-b94d-973c06030b6d response_code = 200 uri = /network-bootstore-config
23062024-11-22T04:01:15.053ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60380
23072024-11-22T04:01:15.053ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60380 req_id = 3a5fbc02-9f51-4567-93b8-fda807c29268 response_code = 200 uri = /baseboard
23082024-11-22T04:01:18.312ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23092024-11-22T04:01:18.312ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23102024-11-22T04:01:18.341ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1907, tv_nsec: 692457170 } time_to_next_cleanup = 599.99999987s
23112024-11-22T04:01:25.641ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7936 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = 3b3874ab-08e3-4b1e-a199-9afc469a822f response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
23122024-11-22T04:01:28.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52785
23132024-11-22T04:01:28.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52785 req_id = 0d5236a6-55ec-43f1-9854-b3da86395de0 response_code = 200 uri = /vpc-routes
23142024-11-22T04:01:28.409ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
23152024-11-22T04:01:28.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52785 req_id = f2d4ebf1-e14d-4b40-9000-3e16ed4e5826 response_code = 204 uri = /eip-gateways
23162024-11-22T04:01:28.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52785 req_id = 351ca9bc-a773-424a-a339-f2c793401af3 response_code = 204 uri = /vpc-routes
23172024-11-22T04:01:28.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40730
23182024-11-22T04:01:28.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40730 req_id = 84077d51-ae81-43bc-88f7-85045b2b1b76 response_code = 200 uri = /v2p
23192024-11-22T04:01:28.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56677
23202024-11-22T04:01:28.531ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23212024-11-22T04:01:28.576ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23222024-11-22T04:01:28.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102682 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56677 req_id = 67abea01-6db8-4cf7-ac84-b4d4c9657e95 response_code = 204 uri = /switch-ports
23232024-11-22T04:01:28.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56677 req_id = ca3cf3a0-3c60-4d2a-af1e-dfe4c91400b9 response_code = 200 uri = /network-bootstore-config
23242024-11-22T04:01:28.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47529
23252024-11-22T04:01:28.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47529 req_id = 41893fe9-599b-4b10-a2b7-94fb90f96570 response_code = 200 uri = /vpc-routes
23262024-11-22T04:01:28.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62834
23272024-11-22T04:01:28.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62834 req_id = fd0788d8-73fd-42a3-a234-cb3ccccfd64a response_code = 200 uri = /v2p
23282024-11-22T04:01:28.735ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
23292024-11-22T04:01:28.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47529 req_id = a7167f23-b9da-4ed3-a661-f9f89303bfd5 response_code = 204 uri = /eip-gateways
23302024-11-22T04:01:28.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47529 req_id = d100eb46-f302-4a81-bd32-991855695caf response_code = 204 uri = /vpc-routes
23312024-11-22T04:01:28.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34059
23322024-11-22T04:01:28.782ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23332024-11-22T04:01:28.822ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23342024-11-22T04:01:28.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93617 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34059 req_id = 0c97c8ef-a3ca-4030-b8f7-b3fd07ed1394 response_code = 204 uri = /switch-ports
23352024-11-22T04:01:28.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34059 req_id = 2bddb4b6-33d7-416d-8d5e-00f8a1e6ff6b response_code = 200 uri = /network-bootstore-config
23362024-11-22T04:01:28.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44526
23372024-11-22T04:01:28.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44526 req_id = 3ffe38ab-35b7-4202-9ccb-da229891638e response_code = 200 uri = /vpc-routes
23382024-11-22T04:01:28.992ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
23392024-11-22T04:01:28.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44526 req_id = 16bfecb6-0940-47a4-a0fd-84ed0d01a3cc response_code = 204 uri = /eip-gateways
23402024-11-22T04:01:29.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50042
23412024-11-22T04:01:29.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50042 req_id = e4136299-993c-454a-a850-57c696963300 response_code = 200 uri = /v2p
23422024-11-22T04:01:29.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 379 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44526 req_id = b7c7157c-40f7-4581-9e81-d5a416d959a6 response_code = 204 uri = /vpc-routes
23432024-11-22T04:01:29.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51336
23442024-11-22T04:01:29.022ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23452024-11-22T04:01:29.063ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23462024-11-22T04:01:29.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94783 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51336 req_id = 8b064994-22b2-4229-8f46-533c6e74779d response_code = 204 uri = /switch-ports
23472024-11-22T04:01:29.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51336 req_id = 7a490afb-e7a8-46c7-9251-213384406146 response_code = 200 uri = /network-bootstore-config
23482024-11-22T04:01:32.834ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23492024-11-22T04:01:45.087ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63999
23502024-11-22T04:01:45.087ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63999 req_id = f4a01cd6-7552-40ae-b3cb-438270c724a0 response_code = 200 uri = /baseboard
23512024-11-22T04:01:55.638ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5432 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = 37f4e471-6bb1-44f7-a6e7-1d380f3811c9 response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
23522024-11-22T04:01:58.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52554
23532024-11-22T04:01:58.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52554 req_id = 4e3c0768-42a2-4b54-b868-796c70d69fa6 response_code = 200 uri = /vpc-routes
23542024-11-22T04:01:58.519ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
23552024-11-22T04:01:58.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52554 req_id = 195bfe9b-b1bd-460f-9ad9-f192f5f56de6 response_code = 204 uri = /eip-gateways
23562024-11-22T04:01:58.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52554 req_id = f12b9e4b-eca8-4794-97ac-1ded41ff7be1 response_code = 204 uri = /vpc-routes
23572024-11-22T04:01:58.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56288
23582024-11-22T04:01:58.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56288 req_id = f6027513-d199-4e9f-9ea8-91e083424347 response_code = 200 uri = /vpc-routes
23592024-11-22T04:01:58.788ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
23602024-11-22T04:01:58.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56288 req_id = 64bfa0e2-cc86-4aa4-8f4a-27b59030980b response_code = 204 uri = /eip-gateways
23612024-11-22T04:01:58.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56288 req_id = 4621b1e6-226a-4451-a6cb-eee4b9c120f3 response_code = 204 uri = /vpc-routes
23622024-11-22T04:01:58.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56462
23632024-11-22T04:01:58.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56462 req_id = 9758deb4-d197-48a3-a8d7-48120f9727f1 response_code = 200 uri = /v2p
23642024-11-22T04:01:58.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48999
23652024-11-22T04:01:58.923ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23662024-11-22T04:01:58.957ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23672024-11-22T04:01:59.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86703 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48999 req_id = 66aff77b-2904-4b44-b505-07446a722530 response_code = 204 uri = /switch-ports
23682024-11-22T04:01:59.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64524
23692024-11-22T04:01:59.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60378
23702024-11-22T04:01:59.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52296
23712024-11-22T04:01:59.010ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23722024-11-22T04:01:59.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 350 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48999 req_id = 70892599-f0d7-4e65-b548-ad766af20df9 response_code = 200 uri = /network-bootstore-config
23732024-11-22T04:01:59.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64524 req_id = f9719d09-ff02-47bb-b1fd-9d896dcec471 response_code = 200 uri = /v2p
23742024-11-22T04:01:59.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3876 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60378 req_id = 5e3a050d-4c89-4703-812d-890151a4dcc3 response_code = 200 uri = /vpc-routes
23752024-11-22T04:01:59.030ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
23762024-11-22T04:01:59.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60378 req_id = cb7806a0-bcc5-4749-b352-daa37fe95feb response_code = 204 uri = /eip-gateways
23772024-11-22T04:01:59.048ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23782024-11-22T04:01:59.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93430 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52296 req_id = 41c0759b-95b6-4319-abba-77a88d357110 response_code = 204 uri = /switch-ports
23792024-11-22T04:01:59.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52296 req_id = 499339aa-0320-490e-8e0a-f19b88da6e1f response_code = 200 uri = /network-bootstore-config
23802024-11-22T04:01:59.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55388
23812024-11-22T04:01:59.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55388 req_id = 5b2f0b75-4ca4-4452-b4f1-3aa6c386720f response_code = 200 uri = /v2p
23822024-11-22T04:01:59.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60378 req_id = 5a2570b3-ea6f-4136-aff0-b86116e54e12 response_code = 204 uri = /vpc-routes
23832024-11-22T04:01:59.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34659
23842024-11-22T04:01:59.212ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23852024-11-22T04:01:59.250ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23862024-11-22T04:01:59.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93211 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34659 req_id = fbe3ab5d-b095-472f-b3a1-68509a151d36 response_code = 204 uri = /switch-ports
23872024-11-22T04:01:59.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34659 req_id = 553bb00d-2fd9-433c-8c2c-a36631eb2420 response_code = 200 uri = /network-bootstore-config
23882024-11-22T04:02:15.121ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39816
23892024-11-22T04:02:15.122ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39816 req_id = ced6fa80-e331-4964-bc83-eb25e6450ec7 response_code = 200 uri = /baseboard
23902024-11-22T04:02:25.639ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6083 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = 40edfb46-7bab-4cd6-ada7-86bb298f86f2 response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
23912024-11-22T04:02:28.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37605
23922024-11-22T04:02:28.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37605 req_id = 19695d88-cb10-475c-b122-2f87b8701060 response_code = 200 uri = /vpc-routes
23932024-11-22T04:02:28.360ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
23942024-11-22T04:02:28.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37605 req_id = ce07be5f-72ec-430b-940f-4726dfccf716 response_code = 204 uri = /eip-gateways
23952024-11-22T04:02:28.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37605 req_id = 93db4a1f-d574-4ead-af63-bdf46ffc0421 response_code = 204 uri = /vpc-routes
23962024-11-22T04:02:28.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37400
23972024-11-22T04:02:28.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37400 req_id = 9cb23949-937a-49c6-a84f-00d17f407b03 response_code = 200 uri = /v2p
23982024-11-22T04:02:28.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45786
23992024-11-22T04:02:28.611ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24002024-11-22T04:02:28.652ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24012024-11-22T04:02:28.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131708 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45786 req_id = 88948dba-b3d1-49bb-9a93-f3d2dd2e1137 response_code = 204 uri = /switch-ports
24022024-11-22T04:02:28.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57563
24032024-11-22T04:02:28.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57563 req_id = 8a5567e4-8aa1-4274-accd-f65e2a765a61 response_code = 200 uri = /vpc-routes
24042024-11-22T04:02:28.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45786 req_id = 5771eafa-6d43-4f75-9f72-f690e222d5dc response_code = 200 uri = /network-bootstore-config
24052024-11-22T04:02:28.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32896
24062024-11-22T04:02:28.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32896 req_id = 409d5a31-bb47-42f8-92d2-ca1f581892cc response_code = 200 uri = /v2p
24072024-11-22T04:02:28.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39262
24082024-11-22T04:02:28.798ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24092024-11-22T04:02:28.833ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24102024-11-22T04:02:28.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86258 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39262 req_id = 2a1af1ec-f92f-4d85-8b06-99248657e784 response_code = 204 uri = /switch-ports
24112024-11-22T04:02:28.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35151
24122024-11-22T04:02:28.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35151 req_id = 6252d064-a885-4db2-a384-02c5a1adeb33 response_code = 200 uri = /vpc-routes
24132024-11-22T04:02:28.884ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
24142024-11-22T04:02:28.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57563 req_id = b1b34fcd-f2ad-4c70-b504-37db8499caad response_code = 204 uri = /eip-gateways
24152024-11-22T04:02:28.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39262 req_id = 3a3e15c8-6fc2-4ab5-ab50-97ae5c2e5f0f response_code = 200 uri = /network-bootstore-config
24162024-11-22T04:02:28.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57563 req_id = bdfd1320-cd8b-46df-a4bc-3d30b2e4339a response_code = 204 uri = /vpc-routes
24172024-11-22T04:02:28.898ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
24182024-11-22T04:02:28.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35151 req_id = 68cbfb65-702c-4f92-ad03-dca10c9c9a1a response_code = 204 uri = /eip-gateways
24192024-11-22T04:02:28.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36232
24202024-11-22T04:02:28.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36232 req_id = 3214168b-16d1-4222-b597-bb8cc92864e9 response_code = 200 uri = /v2p
24212024-11-22T04:02:28.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35151 req_id = 62b725b8-b93a-4148-8a1e-e914d5ddc706 response_code = 204 uri = /vpc-routes
24222024-11-22T04:02:28.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63206
24232024-11-22T04:02:28.943ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24242024-11-22T04:02:28.980ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24252024-11-22T04:02:29.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93822 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63206 req_id = d1528bfe-9c7c-46c7-b37e-2b917f07e33a response_code = 204 uri = /switch-ports
24262024-11-22T04:02:29.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63206 req_id = 64d83d18-3f35-4ad6-ab86-a2589d42bf66 response_code = 200 uri = /network-bootstore-config
24272024-11-22T04:02:45.155ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34981
24282024-11-22T04:02:45.155ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34981 req_id = f23d6cd2-806a-4c52-9dfb-b1e91215d53b response_code = 200 uri = /baseboard
24292024-11-22T04:02:55.640ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7023 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = 9851e5aa-9267-41b1-ae24-cacca579d836 response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
24302024-11-22T04:02:58.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62334
24312024-11-22T04:02:58.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62334 req_id = 1a9e5079-6eef-4e4c-af39-94b59960e9bd response_code = 200 uri = /vpc-routes
24322024-11-22T04:02:58.650ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
24332024-11-22T04:02:58.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62334 req_id = b52e1965-416c-424c-9873-9c84ef9e2dba response_code = 204 uri = /eip-gateways
24342024-11-22T04:02:58.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 374 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62334 req_id = 230e8d1c-11d3-4766-bd8f-8fb95fceca9c response_code = 204 uri = /vpc-routes
24352024-11-22T04:02:58.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46293
24362024-11-22T04:02:58.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46293 req_id = f0ae51f0-dd4b-4ef2-8b13-7ccc7939b609 response_code = 200 uri = /v2p
24372024-11-22T04:02:58.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57764
24382024-11-22T04:02:58.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57764 req_id = 5608f398-370b-4bce-ac61-33f45d9b60fb response_code = 200 uri = /vpc-routes
24392024-11-22T04:02:58.817ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
24402024-11-22T04:02:58.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57764 req_id = ce29c637-f9ad-424d-ba52-27e8751c75aa response_code = 204 uri = /eip-gateways
24412024-11-22T04:02:58.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43751
24422024-11-22T04:02:58.822ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24432024-11-22T04:02:58.859ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24442024-11-22T04:02:58.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92311 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43751 req_id = c0a95807-d569-47ee-a6ff-e969316a0b69 response_code = 204 uri = /switch-ports
24452024-11-22T04:02:58.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36364
24462024-11-22T04:02:58.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51865
24472024-11-22T04:02:58.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36364 req_id = 823ddc3c-30a4-43ed-9692-0ac4df1c6680 response_code = 200 uri = /vpc-routes
24482024-11-22T04:02:58.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 355 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43751 req_id = 322f99a4-0f85-4b78-99b5-7efc1857cee2 response_code = 200 uri = /network-bootstore-config
24492024-11-22T04:02:58.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51865 req_id = 3c6b80d1-cf89-458c-996a-22e31dab645b response_code = 200 uri = /v2p
24502024-11-22T04:02:58.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 621 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57764 req_id = 3a57d8e7-184e-4807-9d8f-ebbdb843bba8 response_code = 204 uri = /vpc-routes
24512024-11-22T04:02:58.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50850
24522024-11-22T04:02:58.922ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24532024-11-22T04:02:58.963ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24542024-11-22T04:02:59.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99158 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50850 req_id = 5073cb1d-8929-4400-94fa-037e1c6251ae response_code = 204 uri = /switch-ports
24552024-11-22T04:02:59.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33631
24562024-11-22T04:02:59.021ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
24572024-11-22T04:02:59.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36364 req_id = fb314ea5-af2e-4611-8284-8d4ab394d8dc response_code = 204 uri = /eip-gateways
24582024-11-22T04:02:59.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50850 req_id = 2e36d86c-7265-407a-a9ce-fd2c6f338cef response_code = 200 uri = /network-bootstore-config
24592024-11-22T04:02:59.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33631 req_id = 270e3120-a7b6-4f00-8c05-69a9a620d9a5 response_code = 200 uri = /v2p
24602024-11-22T04:02:59.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36364 req_id = 3bf037b4-b517-4dd2-8fd8-9ffafd0e8322 response_code = 204 uri = /vpc-routes
24612024-11-22T04:02:59.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34995
24622024-11-22T04:02:59.160ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24632024-11-22T04:02:59.212ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24642024-11-22T04:02:59.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112763 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34995 req_id = 6a883188-9f3a-4a03-81ac-123280cc257d response_code = 204 uri = /switch-ports
24652024-11-22T04:02:59.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34995 req_id = b347c22d-7294-46dd-83b6-d464c6759f45 response_code = 200 uri = /network-bootstore-config
24662024-11-22T04:03:15.188ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42477
24672024-11-22T04:03:15.188ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42477 req_id = 125b0892-a0cc-4b9d-8a19-f166fe24a262 response_code = 200 uri = /baseboard
24682024-11-22T04:03:25.639ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5588 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = 0b3cbc1d-9284-4ce5-9ade-819b6379b49d response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
24692024-11-22T04:03:28.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58912
24702024-11-22T04:03:28.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58912 req_id = e96ff3c1-d950-4d18-a83a-c17559426256 response_code = 200 uri = /vpc-routes
24712024-11-22T04:03:28.505ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
24722024-11-22T04:03:28.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58912 req_id = d91c26ba-4e5e-40b4-a5f9-9924998a8b9d response_code = 204 uri = /eip-gateways
24732024-11-22T04:03:28.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58912 req_id = 7b0f449b-1ec7-4123-859b-7bd07122ea60 response_code = 204 uri = /vpc-routes
24742024-11-22T04:03:28.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50351
24752024-11-22T04:03:28.589ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24762024-11-22T04:03:28.625ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24772024-11-22T04:03:28.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103538 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50351 req_id = b6105205-b070-444a-8593-5901493b4cf7 response_code = 204 uri = /switch-ports
24782024-11-22T04:03:28.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39912
24792024-11-22T04:03:28.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39912 req_id = eb763f0b-f41d-4140-bda0-7aee9e92300c response_code = 200 uri = /v2p
24802024-11-22T04:03:28.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50351 req_id = 3b90753e-ce7d-4aca-8043-8765203a3cd9 response_code = 200 uri = /network-bootstore-config
24812024-11-22T04:03:28.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43579
24822024-11-22T04:03:28.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43579 req_id = 4de7e687-ab86-471c-8ca3-dbf9b4fd0126 response_code = 200 uri = /vpc-routes
24832024-11-22T04:03:28.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44925
24842024-11-22T04:03:28.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44925 req_id = 70dddf64-b7ca-4038-b82c-db4f8df30589 response_code = 200 uri = /vpc-routes
24852024-11-22T04:03:28.759ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
24862024-11-22T04:03:28.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43579 req_id = 5761176b-7f02-4cda-a401-a786d3e4e92c response_code = 204 uri = /eip-gateways
24872024-11-22T04:03:28.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43579 req_id = d1d5f448-0cb7-4f1b-b269-a6f824793b23 response_code = 204 uri = /vpc-routes
24882024-11-22T04:03:28.777ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
24892024-11-22T04:03:28.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44925 req_id = 8de8bb09-d48f-48a9-a6f1-4aafba517a6e response_code = 204 uri = /eip-gateways
24902024-11-22T04:03:28.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44925 req_id = d710612c-b3b9-425d-a77f-ce7df4c707ed response_code = 204 uri = /vpc-routes
24912024-11-22T04:03:28.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50830
24922024-11-22T04:03:28.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50830 req_id = 8ccea468-5831-41a7-897f-ad61e45225af response_code = 200 uri = /v2p
24932024-11-22T04:03:28.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35334
24942024-11-22T04:03:28.828ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24952024-11-22T04:03:28.869ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24962024-11-22T04:03:28.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95447 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35334 req_id = bd218926-7b32-4886-aab1-481b251eb504 response_code = 204 uri = /switch-ports
24972024-11-22T04:03:28.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42834
24982024-11-22T04:03:28.924ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24992024-11-22T04:03:28.959ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25002024-11-22T04:03:29.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87826 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42834 req_id = a86e2863-f3cc-46d2-8d1d-2a582750e011 response_code = 204 uri = /switch-ports
25012024-11-22T04:03:29.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52165
25022024-11-22T04:03:29.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35334 req_id = a2f4553c-ceaa-4ac6-9936-d78ea07fd339 response_code = 200 uri = /network-bootstore-config
25032024-11-22T04:03:29.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42834 req_id = fd3c90ce-c570-46a2-8cb9-965f76336b89 response_code = 200 uri = /network-bootstore-config
25042024-11-22T04:03:29.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52165 req_id = 008dabc3-2f59-466c-b463-36b95b1bc26f response_code = 200 uri = /v2p
25052024-11-22T04:03:45.221ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38871
25062024-11-22T04:03:45.221ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38871 req_id = 7080f3a0-381f-429e-942f-09de64018234 response_code = 200 uri = /baseboard
25072024-11-22T04:03:55.638ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5056 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = 90dcf36e-e656-4799-ab68-fbac23d2ef7e response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
25082024-11-22T04:03:58.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34613
25092024-11-22T04:03:58.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34613 req_id = 95ff17e5-6ccc-4719-a072-6a2b6d3d0173 response_code = 200 uri = /vpc-routes
25102024-11-22T04:03:58.593ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
25112024-11-22T04:03:58.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34613 req_id = 3183d4fe-485f-4596-9885-e48e6f0b89e1 response_code = 204 uri = /eip-gateways
25122024-11-22T04:03:58.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34613 req_id = e99bbdf8-94be-4866-82f8-ef8eaca374fd response_code = 204 uri = /vpc-routes
25132024-11-22T04:03:58.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39103
25142024-11-22T04:03:58.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39103 req_id = f7b3df8c-3846-48c8-83cc-602347bed394 response_code = 200 uri = /vpc-routes
25152024-11-22T04:03:58.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34217
25162024-11-22T04:03:58.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34217 req_id = 065ad97b-b687-4044-a4cb-f3b4ce84f73c response_code = 200 uri = /v2p
25172024-11-22T04:03:58.868ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
25182024-11-22T04:03:58.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39103 req_id = 1c75dedd-6c7e-4dd5-a61e-8e2121377b2f response_code = 204 uri = /eip-gateways
25192024-11-22T04:03:58.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39103 req_id = 00931170-99dd-4458-a777-3142d08e803d response_code = 204 uri = /vpc-routes
25202024-11-22T04:03:58.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57464
25212024-11-22T04:03:58.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57464 req_id = 0937b63c-2c55-4780-a6f2-ce4c12741fc8 response_code = 200 uri = /v2p
25222024-11-22T04:03:58.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56848
25232024-11-22T04:03:58.962ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25242024-11-22T04:03:58.999ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25252024-11-22T04:03:59.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90719 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56848 req_id = 7d09f973-3941-4007-b3bb-7b7904ac6ab6 response_code = 204 uri = /switch-ports
25262024-11-22T04:03:59.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37804
25272024-11-22T04:03:59.053ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25282024-11-22T04:03:59.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56848 req_id = f68ec8fe-c438-4924-998f-d07efdf7bc94 response_code = 200 uri = /network-bootstore-config
25292024-11-22T04:03:59.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40233
25302024-11-22T04:03:59.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40233 req_id = baccb452-108e-4d3c-ab78-fe901875a9b4 response_code = 200 uri = /vpc-routes
25312024-11-22T04:03:59.089ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25322024-11-22T04:03:59.096ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
25332024-11-22T04:03:59.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40233 req_id = 2bf1a27d-130e-4597-abde-8aaf85d080a6 response_code = 204 uri = /eip-gateways
25342024-11-22T04:03:59.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86486 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37804 req_id = 19760cf0-8ae7-4739-add6-88b5bbde0f49 response_code = 204 uri = /switch-ports
25352024-11-22T04:03:59.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37804 req_id = b6292511-887f-4b99-9f42-52ff4b862b32 response_code = 200 uri = /network-bootstore-config
25362024-11-22T04:03:59.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41732
25372024-11-22T04:03:59.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41732 req_id = ace936a8-56dd-439b-9651-52e2074ebf5a response_code = 200 uri = /v2p
25382024-11-22T04:03:59.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40233 req_id = 43c1dcbe-80e1-409d-a680-e05f401d52b4 response_code = 204 uri = /vpc-routes
25392024-11-22T04:03:59.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52647
25402024-11-22T04:03:59.201ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25412024-11-22T04:03:59.234ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25422024-11-22T04:03:59.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87009 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52647 req_id = af44e5f7-f6fc-4ffd-84ad-15a69e3c80f8 response_code = 204 uri = /switch-ports
25432024-11-22T04:03:59.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52647 req_id = f86551b8-bc89-4fd4-83cf-dd9a7f9537ca response_code = 200 uri = /network-bootstore-config
25442024-11-22T04:04:15.255ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58482
25452024-11-22T04:04:15.255ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58482 req_id = 52f68954-77dd-4037-88fe-87cd0543dab6 response_code = 200 uri = /baseboard
25462024-11-22T04:04:25.639ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6466 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = c2feccf9-2272-4a40-8976-55f74984deac response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
25472024-11-22T04:04:28.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64816
25482024-11-22T04:04:28.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64816 req_id = 4187d01e-0fe6-4bc4-940b-556fe4cfeec1 response_code = 200 uri = /vpc-routes
25492024-11-22T04:04:28.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37914
25502024-11-22T04:04:28.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37914 req_id = 52117755-4fac-44af-bb62-03f22d94fe24 response_code = 200 uri = /v2p
25512024-11-22T04:04:28.437ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
25522024-11-22T04:04:28.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64816 req_id = 50067231-963a-4471-9347-50324396a25c response_code = 204 uri = /eip-gateways
25532024-11-22T04:04:28.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64816 req_id = 577d1600-ffef-47f2-ad69-bfe24a586bff response_code = 204 uri = /vpc-routes
25542024-11-22T04:04:28.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62329
25552024-11-22T04:04:28.499ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25562024-11-22T04:04:28.536ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25572024-11-22T04:04:28.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94416 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62329 req_id = a8d55de6-2522-4abc-a48b-b95316d5c4bd response_code = 204 uri = /switch-ports
25582024-11-22T04:04:28.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62329 req_id = 5721dcfb-a37f-4fc9-a101-300adb56a9c5 response_code = 200 uri = /network-bootstore-config
25592024-11-22T04:04:28.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34817
25602024-11-22T04:04:28.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34817 req_id = e484b536-2071-42c9-b579-d53cae8c0360 response_code = 200 uri = /vpc-routes
25612024-11-22T04:04:28.644ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
25622024-11-22T04:04:28.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34817 req_id = 31b74b32-4f33-4670-a101-cc32b1b59ee8 response_code = 204 uri = /eip-gateways
25632024-11-22T04:04:28.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 421 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34817 req_id = 2045c4f9-a209-4a65-894a-d5cee3e1d52f response_code = 204 uri = /vpc-routes
25642024-11-22T04:04:28.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51836
25652024-11-22T04:04:28.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51836 req_id = e2dba4f9-57d5-474d-90f1-b116484ca7fb response_code = 200 uri = /v2p
25662024-11-22T04:04:28.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42561
25672024-11-22T04:04:28.833ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25682024-11-22T04:04:28.868ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25692024-11-22T04:04:28.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89045 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42561 req_id = ff360dd4-6b3d-40ea-b48d-6a06b8051a2c response_code = 204 uri = /switch-ports
25702024-11-22T04:04:28.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64675
25712024-11-22T04:04:28.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47262
25722024-11-22T04:04:28.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42561 req_id = 1c450221-bec0-4e65-9f97-5d374a0d6a08 response_code = 200 uri = /network-bootstore-config
25732024-11-22T04:04:28.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64675 req_id = 0f65a401-29cc-40cd-a512-6c31c2025e2b response_code = 200 uri = /vpc-routes
25742024-11-22T04:04:28.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47262 req_id = 0f1c1fbf-8875-4d0a-9b79-8be2f358778a response_code = 200 uri = /v2p
25752024-11-22T04:04:28.962ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
25762024-11-22T04:04:28.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64675 req_id = a36c5daa-e00d-4eca-85c8-0dc003b9e3ab response_code = 204 uri = /eip-gateways
25772024-11-22T04:04:28.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64675 req_id = a9bf84b7-4f7c-4aa0-a16a-bbeecf3ebc72 response_code = 204 uri = /vpc-routes
25782024-11-22T04:04:29.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39339
25792024-11-22T04:04:29.016ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25802024-11-22T04:04:29.053ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25812024-11-22T04:04:29.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87241 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39339 req_id = b6a7cb89-a0e2-49c7-9957-b9d64c095d17 response_code = 204 uri = /switch-ports
25822024-11-22T04:04:29.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39339 req_id = 6fedb2f1-ceea-40fe-9ac2-f6325d0cab25 response_code = 200 uri = /network-bootstore-config
25832024-11-22T04:04:45.289ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40581
25842024-11-22T04:04:45.289ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40581 req_id = 8caacba7-95fe-4e84-a2c3-053e6618dc93 response_code = 200 uri = /baseboard
25852024-11-22T04:04:55.640ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6841 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = 899f7f99-1df2-4ad3-9900-b7063389f2a4 response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
25862024-11-22T04:04:58.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55224
25872024-11-22T04:04:58.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55224 req_id = 7d0b0fce-be63-4a78-9e84-1f152fb066d1 response_code = 200 uri = /vpc-routes
25882024-11-22T04:04:58.552ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
25892024-11-22T04:04:58.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55224 req_id = 51eeaeae-3d76-47cf-9754-120cce56842a response_code = 204 uri = /eip-gateways
25902024-11-22T04:04:58.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46166
25912024-11-22T04:04:58.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46166 req_id = db34a695-e81b-455f-baeb-3e48ddcf3e79 response_code = 200 uri = /v2p
25922024-11-22T04:04:58.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55224 req_id = 1af972dd-3f89-473e-8313-d1f68c110444 response_code = 204 uri = /vpc-routes
25932024-11-22T04:04:58.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53824
25942024-11-22T04:04:58.809ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25952024-11-22T04:04:58.859ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25962024-11-22T04:04:58.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127916 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53824 req_id = 81c1b7e7-5bd0-4f43-8997-d8390dfd7cf6 response_code = 204 uri = /switch-ports
25972024-11-22T04:04:58.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51781
25982024-11-22T04:04:58.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32898
25992024-11-22T04:04:58.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51781 req_id = adea04b4-05a9-45dc-a98e-026118d534a8 response_code = 200 uri = /vpc-routes
26002024-11-22T04:04:58.938ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26012024-11-22T04:04:58.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53824 req_id = 4403f6fb-5552-419a-a6aa-033caf252d86 response_code = 200 uri = /network-bootstore-config
26022024-11-22T04:04:58.938ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26032024-11-22T04:04:58.938ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-zones.json file = common/src/ledger.rs:178
26042024-11-22T04:04:58.939ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-zones.json file = common/src/ledger.rs:178
26052024-11-22T04:04:58.951ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26062024-11-22T04:04:58.951ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0
26072024-11-22T04:04:58.980ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26082024-11-22T04:04:58.980ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363
26092024-11-22T04:04:58.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47486
26102024-11-22T04:04:58.999ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2abf54e3-2c6c-44eb-b0e3-3fc421a14a03, kind: Service { id: bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b }, name: Name("external-dns-bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 102])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93f11b6b-2dce-465c-b2b0-dad36b7143b0, kind: Service { id: da108ce4-fade-4cd8-8ba2-9af291527495 }, name: Name("external-dns-da108ce4-fade-4cd8-8ba2-9af291527495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33ae9477-921f-41c3-9ac3-5632e24c2bfe, kind: Service { id: 8af2b85f-6ab3-4781-9033-075825f48255 }, name: Name("nexus-8af2b85f-6ab3-4781-9033-075825f48255"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6f13dd-aee1-4596-bad2-e4f9d9529231, kind: Service { id: da73a142-bb8b-46e7-9b17-ceac40c41577 }, name: Name("nexus-da73a142-bb8b-46e7-9b17-ceac40c41577"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 941af30c-f81b-4662-9f74-f275a9cf5c7d, kind: Service { id: 7c7e9efe-c39f-4953-97de-f8eafd979b1a }, name: Name("nexus-7c7e9efe-c39f-4953-97de-f8eafd979b1a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26112024-11-22T04:04:58.999ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26122024-11-22T04:04:58.999ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26132024-11-22T04:04:58.999ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
26142024-11-22T04:04:59.000ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26152024-11-22T04:04:59.000ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26162024-11-22T04:04:59.000ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26172024-11-22T04:04:59.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 417 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47486 req_id = d06f40e2-7d1d-41cf-8416-e6a7dcec836f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26182024-11-22T04:04:59.002ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26192024-11-22T04:04:59.002ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_1182b0f1-244a-4bba-979c-4840fa5a1132
26202024-11-22T04:04:59.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54011
26212024-11-22T04:04:59.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54011 req_id = b62047c9-7b4f-4362-a542-9f5325a4cb73 response_code = 200 uri = /v2p
26222024-11-22T04:04:59.024ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
26232024-11-22T04:04:59.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51781 req_id = fbfea1a9-a742-433b-8a39-a15bcbc14b51 response_code = 204 uri = /eip-gateways
26242024-11-22T04:04:59.027ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26252024-11-22T04:04:59.027ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f
26262024-11-22T04:04:59.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40443
26272024-11-22T04:04:59.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40443 req_id = 4a7214bb-f049-4c57-a7c5-e9c173c43e61 response_code = 200 uri = /vpc-routes
26282024-11-22T04:04:59.053ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26292024-11-22T04:04:59.053ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_157e7505-0f5f-4cc6-9939-e8c05827bf3d
26302024-11-22T04:04:59.077ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26312024-11-22T04:04:59.077ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f13a1c2f-8642-4111-9bab-2dc9809f2e5b
26322024-11-22T04:04:59.097ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26332024-11-22T04:04:59.097ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_48b787c2-7c89-4a59-9296-d71ece8b8529
26342024-11-22T04:04:59.120ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26352024-11-22T04:04:59.120ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e4f74c89-1963-417c-814f-cb22f8634b05
26362024-11-22T04:04:59.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59003
26372024-11-22T04:04:59.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26382024-11-22T04:04:59.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26392024-11-22T04:04:59.137ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-zones.json file = common/src/ledger.rs:178
26402024-11-22T04:04:59.137ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-zones.json file = common/src/ledger.rs:178
26412024-11-22T04:04:59.145ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26422024-11-22T04:04:59.145ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_79b89e7a-03ea-4602-9f51-01fb67551168
26432024-11-22T04:04:59.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 633 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51781 req_id = dc018f3a-5d19-4344-a9e8-70c40abf005b response_code = 204 uri = /vpc-routes
26442024-11-22T04:04:59.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42092
26452024-11-22T04:04:59.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26462024-11-22T04:04:59.164ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26472024-11-22T04:04:59.164ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0
26482024-11-22T04:04:59.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248557 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32898 req_id = e1f5aaeb-ad8e-4f49-983d-877a8f8080fd response_code = 200 uri = /inventory
26492024-11-22T04:04:59.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36888
26502024-11-22T04:04:59.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36888 req_id = 9516ffa7-f5dc-47d4-8123-38a18bc0570c response_code = 200 uri = /v2p
26512024-11-22T04:04:59.190ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26522024-11-22T04:04:59.190ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363
26532024-11-22T04:04:59.198ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26542024-11-22T04:04:59.218ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26552024-11-22T04:04:59.218ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_1182b0f1-244a-4bba-979c-4840fa5a1132
26562024-11-22T04:04:59.228ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
26572024-11-22T04:04:59.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40443 req_id = 9c137c2a-7f71-4253-b755-c2e14f706672 response_code = 204 uri = /eip-gateways
26582024-11-22T04:04:59.245ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26592024-11-22T04:04:59.245ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f
26602024-11-22T04:04:59.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44217
26612024-11-22T04:04:59.265ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2abf54e3-2c6c-44eb-b0e3-3fc421a14a03, kind: Service { id: bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b }, name: Name("external-dns-bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 102])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93f11b6b-2dce-465c-b2b0-dad36b7143b0, kind: Service { id: da108ce4-fade-4cd8-8ba2-9af291527495 }, name: Name("external-dns-da108ce4-fade-4cd8-8ba2-9af291527495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33ae9477-921f-41c3-9ac3-5632e24c2bfe, kind: Service { id: 8af2b85f-6ab3-4781-9033-075825f48255 }, name: Name("nexus-8af2b85f-6ab3-4781-9033-075825f48255"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6f13dd-aee1-4596-bad2-e4f9d9529231, kind: Service { id: da73a142-bb8b-46e7-9b17-ceac40c41577 }, name: Name("nexus-da73a142-bb8b-46e7-9b17-ceac40c41577"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 941af30c-f81b-4662-9f74-f275a9cf5c7d, kind: Service { id: 7c7e9efe-c39f-4953-97de-f8eafd979b1a }, name: Name("nexus-7c7e9efe-c39f-4953-97de-f8eafd979b1a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26622024-11-22T04:04:59.265ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26632024-11-22T04:04:59.265ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26642024-11-22T04:04:59.265ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
26652024-11-22T04:04:59.265ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26662024-11-22T04:04:59.265ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26672024-11-22T04:04:59.265ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26682024-11-22T04:04:59.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 413 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44217 req_id = e173f09d-ef14-441f-8451-801c6179903e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26692024-11-22T04:04:59.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114465 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42092 req_id = 76e63cdf-8a2b-4ef6-a0eb-64f302585135 response_code = 204 uri = /switch-ports
26702024-11-22T04:04:59.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42092 req_id = 1462a10f-846a-43ae-9660-7f024c7b612f response_code = 200 uri = /network-bootstore-config
26712024-11-22T04:04:59.267ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26722024-11-22T04:04:59.267ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_157e7505-0f5f-4cc6-9939-e8c05827bf3d
26732024-11-22T04:04:59.292ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26742024-11-22T04:04:59.292ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f13a1c2f-8642-4111-9bab-2dc9809f2e5b
26752024-11-22T04:04:59.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50132
26762024-11-22T04:04:59.308ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2abf54e3-2c6c-44eb-b0e3-3fc421a14a03, kind: Service { id: bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b }, name: Name("external-dns-bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 102])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93f11b6b-2dce-465c-b2b0-dad36b7143b0, kind: Service { id: da108ce4-fade-4cd8-8ba2-9af291527495 }, name: Name("external-dns-da108ce4-fade-4cd8-8ba2-9af291527495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33ae9477-921f-41c3-9ac3-5632e24c2bfe, kind: Service { id: 8af2b85f-6ab3-4781-9033-075825f48255 }, name: Name("nexus-8af2b85f-6ab3-4781-9033-075825f48255"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6f13dd-aee1-4596-bad2-e4f9d9529231, kind: Service { id: da73a142-bb8b-46e7-9b17-ceac40c41577 }, name: Name("nexus-da73a142-bb8b-46e7-9b17-ceac40c41577"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 941af30c-f81b-4662-9f74-f275a9cf5c7d, kind: Service { id: 7c7e9efe-c39f-4953-97de-f8eafd979b1a }, name: Name("nexus-7c7e9efe-c39f-4953-97de-f8eafd979b1a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26772024-11-22T04:04:59.308ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26782024-11-22T04:04:59.308ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26792024-11-22T04:04:59.308ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
26802024-11-22T04:04:59.309ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26812024-11-22T04:04:59.309ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26822024-11-22T04:04:59.309ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26832024-11-22T04:04:59.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 600 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50132 req_id = 03223ffc-f98f-4399-bf16-212cf1f1d4ac response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26842024-11-22T04:04:59.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40443 req_id = 7af521a2-51be-4c1d-8139-040eef63a0e5 response_code = 204 uri = /vpc-routes
26852024-11-22T04:04:59.315ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26862024-11-22T04:04:59.315ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_48b787c2-7c89-4a59-9296-d71ece8b8529
26872024-11-22T04:04:59.338ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26882024-11-22T04:04:59.338ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e4f74c89-1963-417c-814f-cb22f8634b05
26892024-11-22T04:04:59.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34294
26902024-11-22T04:04:59.356ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26912024-11-22T04:04:59.356ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26922024-11-22T04:04:59.356ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/config/omicron-zones.json file = common/src/ledger.rs:178
26932024-11-22T04:04:59.356ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26942024-11-22T04:04:59.356ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_79b89e7a-03ea-4602-9f51-01fb67551168
26952024-11-22T04:04:59.360ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8681a912-5859-447f-b29e-3905ed40bd28/config/omicron-zones.json file = common/src/ledger.rs:178
26962024-11-22T04:04:59.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59003 req_id = d1817b7f-5a10-4116-ba71-f23b501040ab response_code = 200 uri = /inventory
26972024-11-22T04:04:59.373ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3ab5fd50-00fa-43c1-9edf-f4f9253436c0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26982024-11-22T04:04:59.373ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3ab5fd50-00fa-43c1-9edf-f4f9253436c0
26992024-11-22T04:04:59.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65215
27002024-11-22T04:04:59.377ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27012024-11-22T04:04:59.402ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 249bbc7c-7c05-46b9-b660-83e9c5b05363 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27022024-11-22T04:04:59.402ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_249bbc7c-7c05-46b9-b660-83e9c5b05363
27032024-11-22T04:04:59.419ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27042024-11-22T04:04:59.428ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1182b0f1-244a-4bba-979c-4840fa5a1132 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27052024-11-22T04:04:59.428ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_1182b0f1-244a-4bba-979c-4840fa5a1132
27062024-11-22T04:04:59.456ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27072024-11-22T04:04:59.456ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f
27082024-11-22T04:04:59.485ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 157e7505-0f5f-4cc6-9939-e8c05827bf3d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27092024-11-22T04:04:59.485ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_157e7505-0f5f-4cc6-9939-e8c05827bf3d
27102024-11-22T04:04:59.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112180 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65215 req_id = 92ce9efd-4e39-4c9d-984f-2f74f9bc5ee3 response_code = 204 uri = /switch-ports
27112024-11-22T04:04:59.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65215 req_id = e6c7dd9d-23cd-4428-8eb9-bbabccaccb63 response_code = 200 uri = /network-bootstore-config
27122024-11-22T04:04:59.511ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f13a1c2f-8642-4111-9bab-2dc9809f2e5b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27132024-11-22T04:04:59.511ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f13a1c2f-8642-4111-9bab-2dc9809f2e5b
27142024-11-22T04:04:59.538ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48b787c2-7c89-4a59-9296-d71ece8b8529 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27152024-11-22T04:04:59.539ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_48b787c2-7c89-4a59-9296-d71ece8b8529
27162024-11-22T04:04:59.562ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e4f74c89-1963-417c-814f-cb22f8634b05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27172024-11-22T04:04:59.562ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e4f74c89-1963-417c-814f-cb22f8634b05
27182024-11-22T04:04:59.585ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79b89e7a-03ea-4602-9f51-01fb67551168 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27192024-11-22T04:04:59.585ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_79b89e7a-03ea-4602-9f51-01fb67551168
27202024-11-22T04:04:59.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34294 req_id = 82bd75e6-f1ad-490a-81f0-6f3293cdbfac response_code = 200 uri = /inventory
27212024-11-22T04:05:15.322ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42115
27222024-11-22T04:05:15.323ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42115 req_id = c1713150-6d58-46e5-9841-b1dd5364cc15 response_code = 200 uri = /baseboard
27232024-11-22T04:05:25.639ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5946 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = f36121f7-3f5f-4cdf-b168-c4fb4393d666 response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
27242024-11-22T04:05:28.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33666
27252024-11-22T04:05:28.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33666 req_id = 6455a5eb-df20-4339-be81-c57e8cf5ffd8 response_code = 200 uri = /vpc-routes
27262024-11-22T04:05:28.433ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
27272024-11-22T04:05:28.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33666 req_id = ffe0ae86-55d8-42c2-9e12-74faff30add0 response_code = 204 uri = /eip-gateways
27282024-11-22T04:05:28.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33666 req_id = ca5c7d66-a3d4-4e69-8bec-cc1a4fcccdc1 response_code = 204 uri = /vpc-routes
27292024-11-22T04:05:28.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46188
27302024-11-22T04:05:28.511ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27312024-11-22T04:05:28.553ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27322024-11-22T04:05:28.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99132 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46188 req_id = e0fcd56c-0b19-403f-aec9-4b27e858f631 response_code = 204 uri = /switch-ports
27332024-11-22T04:05:28.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50443
27342024-11-22T04:05:28.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50443 req_id = f3b1b3bf-4cf1-490f-98c8-6298dbcc0f0b response_code = 200 uri = /v2p
27352024-11-22T04:05:28.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46188 req_id = 5cd4ef7a-4bff-43f7-a5da-81056b220751 response_code = 200 uri = /network-bootstore-config
27362024-11-22T04:05:28.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57472
27372024-11-22T04:05:28.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57472 req_id = 077fa39b-287a-44c8-aedd-d497770b9b82 response_code = 200 uri = /vpc-routes
27382024-11-22T04:05:28.740ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
27392024-11-22T04:05:28.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57472 req_id = 38c3b683-a475-4533-9445-d2420ef14399 response_code = 204 uri = /eip-gateways
27402024-11-22T04:05:28.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 349 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57472 req_id = 68eca016-abc1-4ebd-a902-791ced872c77 response_code = 204 uri = /vpc-routes
27412024-11-22T04:05:28.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49161
27422024-11-22T04:05:28.788ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27432024-11-22T04:05:28.827ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27442024-11-22T04:05:28.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95027 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49161 req_id = 7b834313-add0-4a28-b207-fa31175f4928 response_code = 204 uri = /switch-ports
27452024-11-22T04:05:28.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34269
27462024-11-22T04:05:28.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41696
27472024-11-22T04:05:28.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3642 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49161 req_id = f0a3c4f4-864a-4d95-bd53-bd72388dc3fa response_code = 200 uri = /network-bootstore-config
27482024-11-22T04:05:28.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 385 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34269 req_id = 2e9a065e-a087-47fe-b65a-7f3d9731ed65 response_code = 200 uri = /vpc-routes
27492024-11-22T04:05:28.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 586 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41696 req_id = 99c2b700-20bb-4583-a143-eb563b5c5307 response_code = 200 uri = /v2p
27502024-11-22T04:05:28.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35924
27512024-11-22T04:05:28.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35924 req_id = cd8cd1ea-2657-4ad0-849d-716e64fd05db response_code = 200 uri = /v2p
27522024-11-22T04:05:28.934ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
27532024-11-22T04:05:28.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34269 req_id = 6b7a5136-0aef-4863-9083-bdc32d846a0e response_code = 204 uri = /eip-gateways
27542024-11-22T04:05:28.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34269 req_id = 816a752a-2d01-455d-b2e4-c2d3bf4b17ec response_code = 204 uri = /vpc-routes
27552024-11-22T04:05:28.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51352
27562024-11-22T04:05:28.961ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27572024-11-22T04:05:29.000ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27582024-11-22T04:05:29.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103259 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51352 req_id = eda08245-3c7b-47c6-99a6-617321e297c2 response_code = 204 uri = /switch-ports
27592024-11-22T04:05:29.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51352 req_id = 0eb9c2ca-6b70-45d9-8ced-29bf94f30c77 response_code = 200 uri = /network-bootstore-config
27602024-11-22T04:05:45.356ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58747
27612024-11-22T04:05:45.356ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58747 req_id = 0fee8592-ac9d-45ce-b3a1-41c14060f83c response_code = 200 uri = /baseboard
27622024-11-22T04:05:55.639ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6499 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = 6dd4ff61-df29-440d-91e2-3271cbc6b3d6 response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
27632024-11-22T04:05:58.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49325
27642024-11-22T04:05:58.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49325 req_id = f12064b3-da80-4520-ac56-2a5f985185a7 response_code = 200 uri = /vpc-routes
27652024-11-22T04:05:58.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40891
27662024-11-22T04:05:58.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40891 req_id = a38dd8ad-0ba3-457f-bbca-46a248cd4f1c response_code = 200 uri = /v2p
27672024-11-22T04:05:58.604ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
27682024-11-22T04:05:58.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49325 req_id = 4ecbaddb-caa8-4320-a426-0c1e24acd095 response_code = 204 uri = /eip-gateways
27692024-11-22T04:05:58.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49325 req_id = 1f092299-7b51-4228-9a71-6448a4fac116 response_code = 204 uri = /vpc-routes
27702024-11-22T04:05:58.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49045
27712024-11-22T04:05:58.693ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27722024-11-22T04:05:58.743ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27732024-11-22T04:05:58.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139473 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49045 req_id = 32bfb3b7-6521-4aef-a4c3-d4ffb30ee1be response_code = 204 uri = /switch-ports
27742024-11-22T04:05:58.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44948
27752024-11-22T04:05:58.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49045 req_id = 35bbed0b-43ae-4fe8-9414-724b32bc9c87 response_code = 200 uri = /network-bootstore-config
27762024-11-22T04:05:58.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44948 req_id = 49297d8a-6f5b-4435-ad6e-eb5ab6b7d2ea response_code = 200 uri = /vpc-routes
27772024-11-22T04:05:58.880ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
27782024-11-22T04:05:58.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44948 req_id = b9f58d58-ee1a-401c-b467-1a797f7bd8ac response_code = 204 uri = /eip-gateways
27792024-11-22T04:05:58.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44948 req_id = c8c22968-8261-48aa-af16-8cb395981ffc response_code = 204 uri = /vpc-routes
27802024-11-22T04:05:59.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47103
27812024-11-22T04:05:59.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47103 req_id = 450d4359-4e23-4fd8-bc12-78dbea47afc4 response_code = 200 uri = /v2p
27822024-11-22T04:05:59.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58217
27832024-11-22T04:05:59.045ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27842024-11-22T04:05:59.076ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27852024-11-22T04:05:59.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83156 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58217 req_id = 9e322406-fae6-4ff5-b18b-0d352f4d0db8 response_code = 204 uri = /switch-ports
27862024-11-22T04:05:59.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58333
27872024-11-22T04:05:59.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58217 req_id = d3b41d32-b179-473c-8032-04b2a195b0da response_code = 200 uri = /network-bootstore-config
27882024-11-22T04:05:59.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58333 req_id = 7f939a10-9020-493d-a82c-6af7c2fbd550 response_code = 200 uri = /vpc-routes
27892024-11-22T04:05:59.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59577
27902024-11-22T04:05:59.143ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27912024-11-22T04:05:59.182ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27922024-11-22T04:05:59.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94664 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59577 req_id = 729b37e1-0a90-450e-bb86-b1d6b4417ed7 response_code = 204 uri = /switch-ports
27932024-11-22T04:05:59.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51428
27942024-11-22T04:05:59.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59577 req_id = e13e2403-827d-4ecf-a23a-4ad1f82eb3d5 response_code = 200 uri = /network-bootstore-config
27952024-11-22T04:05:59.238ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
27962024-11-22T04:05:59.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58333 req_id = a9c2386d-52a6-4cc9-b212-33117a6efbaf response_code = 204 uri = /eip-gateways
27972024-11-22T04:05:59.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51428 req_id = 9e74bf91-8723-4b3d-b976-37834f46d83b response_code = 200 uri = /v2p
27982024-11-22T04:05:59.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58333 req_id = 50abe8f2-52c3-439b-87d6-b1089d7225e1 response_code = 204 uri = /vpc-routes
27992024-11-22T04:06:03.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36035
28002024-11-22T04:06:03.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36035 req_id = b454fb6e-ab14-418a-ba18-44c11e9388b9 response_code = 200 uri = /v2p
28012024-11-22T04:06:03.764ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(14082982) }
28022024-11-22T04:06:03.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3594 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36035 req_id = fd3004cc-95d4-49dd-bee3-af69a7906123 response_code = 204 uri = /v2p
28032024-11-22T04:06:03.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53344
28042024-11-22T04:06:03.889ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 48c8bf56-0200-4b8a-84ca-080979091ea5, kind: Instance { id: 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14082982), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 48c8bf56-0200-4b8a-84ca-080979091ea5, kind: Instance { id: 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14082982), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 48c8bf56-0200-4b8a-84ca-080979091ea5, kind: Instance { id: 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14082982), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14082982))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 48c8bf56-0200-4b8a-84ca-080979091ea5, kind: Instance { id: 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14082982), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-82f194814ce", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 6124d708-a5d5-42bd-b7fa-e59ee4227735, read_only_parent: Some(Volume { block_size: 512, id: e809a010-1526-451a-90d9-ce2a6e758dd6, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 8f0fd727-027a-48f8-8dd7-cde14cd45d6d, key: Some("2OFOHWDCcOMhyMvToz93VEhjNWksCAeFz015gQT+rkA="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 6124d708-a5d5-42bd-b7fa-e59ee4227735, key: Some("44yQoXqyfrRg5VvJNgVe0qja15fyqQ3Qbdi89OjDJvk="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::1a]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-82f194814ce" }] }), cloud_init_bytes: Some(..) } instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 metadata = InstanceMetadata { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, project_id: 3ac1be93-6287-4d44-9a76-4ff624883fe3 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-22T04:06:03.882078802Z }
28052024-11-22T04:06:03.889ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 migration_id = None propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28062024-11-22T04:06:03.891ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 migration_id = None propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 48c8bf56-0200-4b8a-84ca-080979091ea5, kind: Instance { id: 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14082982), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 48c8bf56-0200-4b8a-84ca-080979091ea5, kind: Instance { id: 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14082982), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 48c8bf56-0200-4b8a-84ca-080979091ea5, kind: Instance { id: 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14082982), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(14082982))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 48c8bf56-0200-4b8a-84ca-080979091ea5, kind: Instance { id: 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(14082982), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-82f194814ce", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 6124d708-a5d5-42bd-b7fa-e59ee4227735, read_only_parent: Some(Volume { block_size: 512, id: e809a010-1526-451a-90d9-ce2a6e758dd6, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 8f0fd727-027a-48f8-8dd7-cde14cd45d6d, key: Some("2OFOHWDCcOMhyMvToz93VEhjNWksCAeFz015gQT+rkA="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 6124d708-a5d5-42bd-b7fa-e59ee4227735, key: Some("44yQoXqyfrRg5VvJNgVe0qja15fyqQ3Qbdi89OjDJvk="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::1a]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-82f194814ce" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-22T04:06:03.882078802Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
28072024-11-22T04:06:03.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53344 req_id = 0f33d042-750d-4813-8936-736f966f5ce3 response_code = 200 uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
28082024-11-22T04:06:03.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33249
28092024-11-22T04:06:03.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33249 req_id = 9bee2d59-1c8a-4d9e-82e7-c4885b6abd1f response_code = 200 uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1/state
28102024-11-22T04:06:03.972ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 14082982 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
28112024-11-22T04:06:03.972ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28122024-11-22T04:06:04.011ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1 file = illumos-utils/src/zone.rs:325 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28132024-11-22T04:06:04.035ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1 file = illumos-utils/src/zone.rs:363 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28142024-11-22T04:06:04.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51935
28152024-11-22T04:06:04.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51935 req_id = db414b3c-949a-40b8-9935-5ad7d7a2f72d response_code = 200 uri = /vpc-routes
28162024-11-22T04:06:04.091ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {48c8bf56-0200-4b8a-84ca-080979091ea5: {10.151.2.175: {09f75164-2418-4be9-994f-7f2da4d485ab}, 10.151.2.176: {09f75164-2418-4be9-994f-7f2da4d485ab}}} }
28172024-11-22T04:06:05.864ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28182024-11-22T04:06:05.864ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 zone = oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1
28192024-11-22T04:06:06.055ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1") failed: Property not found. retry in 25.66738ms file = illumos-utils/src/svc.rs:36 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 zone = oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1
28202024-11-22T04:06:06.089ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1") failed: Property not found. retry in 52.422746ms file = illumos-utils/src/svc.rs:36 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 zone = oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1
28212024-11-22T04:06:06.155ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1") failed: Property not found. retry in 268.695183ms file = illumos-utils/src/svc.rs:36 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 zone = oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1
28222024-11-22T04:06:06.444ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1") failed: Property not found. retry in 248.755322ms file = illumos-utils/src/svc.rs:36 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 zone = oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1
28232024-11-22T04:06:06.708ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1") failed: Property not found. retry in 754.880707ms file = illumos-utils/src/svc.rs:36 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 zone = oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1
28242024-11-22T04:06:07.475ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1") failed: Property not found. retry in 565.621995ms file = illumos-utils/src/svc.rs:36 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 zone = oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1
28252024-11-22T04:06:08.054ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1") failed: Property not found. retry in 761.963586ms file = illumos-utils/src/svc.rs:36 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 zone = oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1
28262024-11-22T04:06:08.827ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1") failed: Property not found. retry in 1.492936616s file = illumos-utils/src/svc.rs:36 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 zone = oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1
28272024-11-22T04:06:10.330ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1") failed: Property not found. retry in 744.548464ms file = illumos-utils/src/svc.rs:36 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 zone = oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1
28282024-11-22T04:06:11.106ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1 file = sled-agent/src/instance.rs:1787 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28292024-11-22T04:06:11.116ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1") failed: Property not found. retry in 27.693363ms file = illumos-utils/src/svc.rs:36 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28302024-11-22T04:06:11.154ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1") failed: Property not found. retry in 95.773796ms file = illumos-utils/src/svc.rs:36 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28312024-11-22T04:06:11.260ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1") failed: Property not found. retry in 254.969639ms file = illumos-utils/src/svc.rs:36 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28322024-11-22T04:06:11.524ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1") failed: Property not found. retry in 230.919357ms file = illumos-utils/src/svc.rs:36 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28332024-11-22T04:06:11.765ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28342024-11-22T04:06:11.803ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28352024-11-22T04:06:11.942ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28362024-11-22T04:06:11.944ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-22T04:06:11.944802466Z } file = sled-agent/src/instance.rs:780 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28372024-11-22T04:06:11.945ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-22T04:06:11.944802466Z } propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28382024-11-22T04:06:11.945ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-22T04:06:11.944802466Z }, migration_in: None, migration_out: None }
28392024-11-22T04:06:11.945ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1224 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
28402024-11-22T04:06:11.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7853912 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51935 req_id = 13ec019b-2125-4723-90ff-d69282c6d6c4 response_code = 204 uri = /eip-gateways
28412024-11-22T04:06:11.975ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-22T04:06:11.975370179Z } file = sled-agent/src/instance.rs:780 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28422024-11-22T04:06:11.975ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-22T04:06:11.975370179Z } propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28432024-11-22T04:06:11.975ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-22T04:06:11.975370179Z }, migration_in: None, migration_out: None }
28442024-11-22T04:06:12.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 554 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51935 req_id = 56067c3c-1a35-4667-b301-c9f460e5521b response_code = 204 uri = /vpc-routes
28452024-11-22T04:06:15.389ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52435
28462024-11-22T04:06:15.389ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52435 req_id = 97616e8b-9426-4009-a459-cc693d5de7b8 response_code = 200 uri = /baseboard
28472024-11-22T04:06:21.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52114
28482024-11-22T04:06:21.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 602 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52114 req_id = 7d5143f4-48a4-4ca5-986d-c995b943f0f7 response_code = 200 uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1/state
28492024-11-22T04:06:21.495ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-22T04:06:21.495918661Z } file = sled-agent/src/instance.rs:780 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28502024-11-22T04:06:21.495ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-22T04:06:21.495918661Z } propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28512024-11-22T04:06:21.495ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-22T04:06:21.495918661Z }, migration_in: None, migration_out: None }
28522024-11-22T04:06:21.511ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-22T04:06:21.511103051Z } file = sled-agent/src/instance.rs:780 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28532024-11-22T04:06:21.511ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-22T04:06:21.511103051Z } propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28542024-11-22T04:06:21.511ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28552024-11-22T04:06:21.511ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28562024-11-22T04:06:21.511ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28572024-11-22T04:06:21.511ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/648422bd-ca86-416f-b3b1-9ff65fbad8bb/debug/bundle/zone", "/pool/int/8681a912-5859-447f-b29e-3905ed40bd28/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/3ab5fd50-00fa-43c1-9edf-f4f9253436c0/crypt/debug", "/pool/ext/249bbc7c-7c05-46b9-b660-83e9c5b05363/crypt/debug", "/pool/ext/1182b0f1-244a-4bba-979c-4840fa5a1132/crypt/debug", "/pool/ext/3ef6a0a9-4aa8-44b7-a585-bf14e6f07c8f/crypt/debug", "/pool/ext/157e7505-0f5f-4cc6-9939-e8c05827bf3d/crypt/debug", "/pool/ext/f13a1c2f-8642-4111-9bab-2dc9809f2e5b/crypt/debug", "/pool/ext/48b787c2-7c89-4a59-9296-d71ece8b8529/crypt/debug", "/pool/ext/e4f74c89-1963-417c-814f-cb22f8634b05/crypt/debug", "/pool/ext/79b89e7a-03ea-4602-9f51-01fb67551168/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1
28582024-11-22T04:06:22.145ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1", bundle_id: 8c14225b-e6d6-4579-8468-70f38a3fd4f2 }, time_created: 2024-11-22T04:06:21.512340223Z, version: 0, cause: TerminatedInstance }
28592024-11-22T04:06:22.145ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_ac35c2a3-f0ae-4a40-8af0-513950af66a1 file = sled-agent/src/instance.rs:1032 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28602024-11-22T04:06:23.881ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28612024-11-22T04:06:23.899ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(14082982), kind: System }
28622024-11-22T04:06:23.899ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(14082982), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28632024-11-22T04:06:23.899ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-22T04:06:23.899866187Z }, migration_in: None, migration_out: None }
28642024-11-22T04:06:23.967ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-22T04:06:23.899866187Z }, migration_in: None, migration_out: None }
28652024-11-22T04:06:23.971ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1
28662024-11-22T04:06:24.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52899
28672024-11-22T04:06:24.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52899 req_id = 216794cf-d33d-4b50-b8c4-92711258efd0 response_code = 200 uri = /vpc-routes
28682024-11-22T04:06:24.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33392
28692024-11-22T04:06:24.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33392 req_id = a47e957e-1b9f-4705-9b59-934b652f5f03 response_code = 200 uri = /v2p
28702024-11-22T04:06:24.638ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
28712024-11-22T04:06:24.638ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1224 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465
28722024-11-22T04:06:24.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52899 req_id = bce04b1d-dda4-4363-b9b9-d6e3ca4b6a38 response_code = 204 uri = /eip-gateways
28732024-11-22T04:06:24.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52899 req_id = 328247fb-c05e-4221-af96-2801a65e7e19 response_code = 204 uri = /vpc-routes
28742024-11-22T04:06:25.640ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6542 local_addr = [fd00:1122:3344:101::1]:57755 method = GET remote_addr = [fd00:1122:3344:101::d]:54673 req_id = ac68cb7c-d095-4be7-936e-a92b106aaa6c response_code = 200 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 uri = /fcd04c0f-1471-4403-b8d9-fe281f829465
28752024-11-22T04:06:25.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43261
28762024-11-22T04:06:25.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43261 req_id = 96908134-6224-4530-8034-f958a16829f2 response_code = 200 uri = /v2p
28772024-11-22T04:06:25.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49385
28782024-11-22T04:06:25.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49385 req_id = 035095dc-c824-498f-bf01-e81bc2eb55b8 response_code = 200 uri = /vpc-routes
28792024-11-22T04:06:25.875ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
28802024-11-22T04:06:25.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49385 req_id = bdfe548d-bc5d-401d-a383-05fea9b19df8 response_code = 204 uri = /eip-gateways
28812024-11-22T04:06:25.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49385 req_id = e7585de8-56ec-4922-af83-2308f4750b1a response_code = 204 uri = /vpc-routes
28822024-11-22T04:06:26.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39154
28832024-11-22T04:06:26.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39154 req_id = 033431c6-c274-41ef-83e2-b47618dc60a6 response_code = 200 uri = /vpc-routes
28842024-11-22T04:06:26.513ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
28852024-11-22T04:06:26.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39154 req_id = 202af134-97c8-4b9f-9fc2-e26294406e23 response_code = 204 uri = /eip-gateways
28862024-11-22T04:06:26.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39154 req_id = bcfef67e-9c30-471a-b93e-933456467d3b response_code = 204 uri = /vpc-routes
28872024-11-22T04:06:28.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37986
28882024-11-22T04:06:28.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37986 req_id = a71bb21c-203c-45e4-923d-5bc9725e6d99 response_code = 200 uri = /v2p
28892024-11-22T04:06:28.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37737
28902024-11-22T04:06:28.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37737 req_id = 74ba6950-c6b6-4987-8695-0602c2f2db25 response_code = 200 uri = /vpc-routes
28912024-11-22T04:06:28.569ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
28922024-11-22T04:06:28.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37737 req_id = a5eb4699-804d-4db9-ac74-995e2f51271a response_code = 204 uri = /eip-gateways
28932024-11-22T04:06:28.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37737 req_id = 0c0a4dc4-3b09-470d-bd84-8c96e988871c response_code = 204 uri = /vpc-routes
28942024-11-22T04:06:28.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39964
28952024-11-22T04:06:28.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39964 req_id = f93c9294-0694-433a-ae45-89b24bba5b28 response_code = 200 uri = /vpc-routes
28962024-11-22T04:06:28.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37495
28972024-11-22T04:06:28.628ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28982024-11-22T04:06:28.675ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28992024-11-22T04:06:28.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120331 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37495 req_id = 01712a4c-d045-4e87-90e9-ab2572e8dd2b response_code = 204 uri = /switch-ports
29002024-11-22T04:06:28.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37578
29012024-11-22T04:06:28.748ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
29022024-11-22T04:06:28.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39964 req_id = de1c9b00-2d40-49c5-9305-6263d6fbdb8b response_code = 204 uri = /eip-gateways
29032024-11-22T04:06:28.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37495 req_id = 9abb1509-5e46-4889-9146-7469758f7163 response_code = 200 uri = /network-bootstore-config
29042024-11-22T04:06:28.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37578 req_id = 90275fef-a62d-4d7e-8fe4-6b2845547886 response_code = 200 uri = /v2p
29052024-11-22T04:06:28.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47528
29062024-11-22T04:06:28.752ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29072024-11-22T04:06:28.790ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29082024-11-22T04:06:28.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95996 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47528 req_id = 0a0992e8-119e-4915-89d7-f640c2f250eb response_code = 204 uri = /switch-ports
29092024-11-22T04:06:28.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47528 req_id = a650fbc1-6b54-40e8-8104-0715b7a4f9e6 response_code = 200 uri = /network-bootstore-config
29102024-11-22T04:06:28.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 492 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39964 req_id = 59205349-d701-4e2f-bd36-32f871ce26c3 response_code = 204 uri = /vpc-routes
29112024-11-22T04:06:28.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37054
29122024-11-22T04:06:28.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37054 req_id = 00d5cda7-d5ea-4f4c-8ee2-aa9e48163c88 response_code = 200 uri = /vpc-routes
29132024-11-22T04:06:28.863ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1198 sled_id = fcd04c0f-1471-4403-b8d9-fe281f829465 values = ExternalIpGatewayMap { mappings: {} }
29142024-11-22T04:06:28.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37054 req_id = 9ae92516-c286-4905-abd4-11f9b18bd516 response_code = 204 uri = /eip-gateways
29152024-11-22T04:06:28.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43420
29162024-11-22T04:06:28.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43420 req_id = 17663689-869a-413a-b02c-ef763ae3baa6 response_code = 200 uri = /v2p
29172024-11-22T04:06:28.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37054 req_id = a680205d-bcf2-4fbe-9dee-481c5d08498f response_code = 204 uri = /vpc-routes
29182024-11-22T04:06:28.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45536
29192024-11-22T04:06:28.994ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29202024-11-22T04:06:29.035ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29212024-11-22T04:06:29.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97720 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45536 req_id = 291e2c54-99fd-4778-af73-34af051d29ef response_code = 204 uri = /switch-ports
29222024-11-22T04:06:29.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45536 req_id = 4b3d2efd-1cb9-469f-a4da-0f0cbb9ad15c response_code = 200 uri = /network-bootstore-config